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ABSTRACT 

Two postsecondary institutions in Michigan, Macomb 
County Community College ^and Michigan State Oniversity, participated 
in a two-year program that attempted to implement and evaluate a set 
of procedures developed for measuring and mapping each studen't's 
\ educational cognitive style and using the resulting maps to 

individualize educational programs to accommodate students' styles. 
Based on a program developed by Joseph E. Hill of Oakland Community 
College in Hichiga|i, the project specified four objectives: (1) to . 
develop and test procedures for the measurement of the 32 dimensions 
of Hill's model of educational cognitive style; (2) to train faculty 
and staff of the participating institutions to understand the model; 
(3) to assist these trained faculty members in developing and 
carrying out plans for implementing cognitive style mapping 
procedures in making educational decisions in their individual 
courses; and (4) to plan and carry out systematic evaluations of the 
effect of the mapping procedures and data on educational outcomes in 
each setting. The project results did not establish the existence of 
significant relationships between the use of cognitive style measures 
and data on educational outcomes. Study results are presented in 
numerous tables and an appendix contains the reports of the 
evaluation advisory panel. (JMD) 
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CHAPTER 1 



INTRODUCTION 



Overview of the Problem 

In the past decade, there has been a marked change In the 
characteristics of the* postsecondary student population. 
An unprecedented proportion of the total population of 
high school graduates has sought some form of post- 
secondary education. Individuals traditionally denied 
access to higher education, especially those from low 
socioeconomic backgrounds and . members of minority 
groups, have enrolled In ever-increasing numbers.. This 
increased diversity of the postsecondary-student popu- 
lation has been accelerated by the growing number of 
adults who are returning to school for the additional 
training or retraining required in a dynamically changing 
society. As a result of all of^hese past and present changes, 
there are substantial variations in the background experi- 
ences, personality characteristics, and entering academic 
and occupational competencies of students enrolling In 
postsecondary institutions. 

in contrast to this great change in student-body character- 
istics, there have been few significant changes In instruc- 
tional procedures at most postsecondary institutions. 
Education is often viewed as a process In which the Instruc- 
tor is the dispenser of knowledge and the student the 
receptor. Only modest attempts have been made to 
provide remedial or enrichment experiences for students 
who are ill equipped to enter the mainstream of the institu- 
tions' programs. Little emphasis has been placed on Identi- 
fying educationally relevant individual differences among 
students and even less h*as been placed on adapting the 
learning environment to accommodate those differences. 

Attrition among postsecondary students — a problem that is 
especially apparent In community colleges— may be a 
result of the Institutions' failure to respond to the Increas- 
ingly diverse needs of a changing student population. 
Since a complex technological society demands advanced 
training for an increasing number of citizens, students' 
different needs should be analyzed and new teaching tech- 
niques designed to provide a reasonable probability of suc- 
cessful accomplishment of educational objectives. 

Although some attempts have been made to alleviate the 
problems arising from the diversity in the capabilities of 
entering students, these attempts have typically been 
stopgap in na.jre. Special recruitment programs and 
special tutorial and support services, although helpful. 



have only made superficial attacks on symploms rather 
than attempts to address causal factors. Moreover, 
attempt^ to provide tutorial assistance In sheltered learn- 
ing environments for students with academic deficiencies 
have sometimes been accompanied by a lowering of 
expectations of performance. 

A potential solution to this problem of accommodating 
individual differences in postsecondary Instruction has 
been developed by Dr. Joseph E. Hill, President, Oakland 
Community College, Bioomfield Hills, Michigan, and his 
associates. Hill has suggested an approach to the measure- 
ment of student characteristics which Is a reflection of the 
manner In which Individual learners derive meaning from 
their environment. Using measures of achievement, atti- 
tude, and Interests, Hill maps each student's educational 
cognitive style. He and others working with him assert that 
they can match styles of each student with diverse modes 
of instruction, thus enhancing the educational process. 
Indeed, over the past several years, they have imple- 
mented such procedures at several institutions, including 
Oakland Community College. 



Review of Project Objectives . 

The overall purpose of this project was to implement Hill's 
educational cognitive style mapping procedures in Institu- 
tions other than Oakland Community College so that the 
effectiveness of such procedures could be systematically 
and objectively evaluated In terms of educational out- 
comes. The specific objectives of the project were: 

1. to devise, develop, field test, and refine procedures for 
the measurement of the various dimensions of Hill's 

^model of educational cognitive style; 

2. to train faculty and staff in postsecondary educational 
settings to understand the conceptual framework of 
educational cognitive style; 

3. to assist these trained (acuity members in developing 
and carrying out plans for implementing cognitive style 
mapping procedures In making educational decisions In 
their Individual settings; and 
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4. to plan and carry out systematic and objective evalua- 
tions of the effect of the cognitive style mapping proce- 
dures and data on educational outcomes in each imple- 
mentation setting. 



Project Umitations 

There are many diverse conceptualizations of cognitive 
style that have been developed over the years. This study 
concentrated total'y on educational cognitive style as con- 
^ ceptualized by Hill. This conceptualjzation includes a total 



of 32 style dimensions in three categories: (1) Symbols and 
Their Meanings, (2) Cultural Determinants, and (3) Mortali- 
ties of Inference. Each of these style dimensions or 
elements is listed in the brief overview of educational 
cognitive style elements provided in Table 1.1. 

Definitions of cognitive style, such as those espoused by 
Witkin; Kagan, Siegel; and Moss; and others, were not 
addressed in this project. Therefore; the term cognitive 
style in this document refers only to the Hill model. In 
addition, all generalizations and conclusions made apply 
only to the Hill model as implemented in this study and not 
to other conceptualizations of cognitive style. 



TABLE 1.1 

Dimensions of the Cognitive Style Map 



I. Symbots and Their Meanings 

Two types of symbols, theoretical and qualitative, are created and used by individuals to acquire knowledge and derive 

meaning from their environments and personal experiences. Theoretical symbols present to the awareness of the individual 

something different from that which the symbols are. Words and numbers are examples of theoretical symbols. Qualitative 

symbols present and then represent to the individual that which the symbol is. Feelings, commitments, and values are examples 

oi the meanings conveyed by qualitative symbols. Theoretical symbols include: 

T(VL)— Theoretical Visual Linguistics— ability to find meaning in written words 

T(AL)—Theoretical Auditory Linguistics— ability tq acquire meaning through hearing spoken words 

T(VQ)— Theoretical Visual Quantitative— ability to acquire meaning in terms of numerical symbols, relationships, and 
measurements that are /written 

T(AQ)— Theoretical Auditory Quantitative— ability to acquire meaning in terms of numerical symbols, relationships, and 
measurements that are spoken 

The four qur'lilative symbols associated with sensory stimuli are: 

Q(A)— Qualitative Auditory— ability to perceive meaning through the sense uf hearing 

Q(0)— Qualitative Olfactory— ability to perceive moaning through the sense of smell 

Q(T)— Qualitative Tactile— ability to perceive meaning through the sense of touch, temperature, and pain 

Q(V)— Qualitative Visual— ability to perceive meaning through sight 

The qualitative symbols that are programmatic in nature are: 

Q(PF)— Qualitative Proprioceptive (Fine)— ability to synthesize a number of symbolic mediations into a performance 
demanding monitoring of a complex task involving small, or fine, musculature (e.g., playing a musical instrument, typewriting) 

• Q(PG)— Qualitative Proprioceptive (Gross)— ability to synthesize a number of symbolic mediations into a performance 
demanding monitoring of a complex task involving large, or gross, musculature (e.g., throwing a -baseball, skiing) 

Q(PKF)— Qualitative Proprioceptive Kinematics (Fine)— ability to synthesize a number of symbolic mediations into d perfor- 
mance demanding the use of fine musculature while moritoring a complex physical activity involving motion 

Q(PKG)— Qualitative Proprioceptive Kinematics (Gross)— ability to synthesize a number of symbolic mediations into a perfor- 
mance demanding the use of gross musculature while monitoring a complex physical activity involving motion 
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Q(PTF)— Qualitiatlve Proprioceptive Temporal (Fine)— ability to synthesize a number of symbolic mediations into . ^rfor- 
mance demanding the use of fine musculature while monitoring a complex physical activity involving timing 

Q(PTG) — Qualitative Proprioceptive Temporal (Gross)— ability to synthesize a number of symbolic mediations into a perfor- 
mance demanding the use of yross musculature while monitoring a complex physical activity involving liming 

The remaining are defined as: 

Q(CEM)— Qualitative Code Empathetic—- sensitivity to the feelings of others 

Q(CES)— Qualitative Code Esthetic— ability to enjoy the beauty of an object or an idea 

Q(CEt) — Qualitaiive Code Ethic— commitment to a set of values, a group of principles, obligations and/or duties 

Q(CH) — Qualitative Code Histrionic— ^ability to exhibit a deliberate behavior, or play a role to produce some particular effect 
on other persons 

Q(CK) — Qualitative Code Kinesics— ability to understand, and to communicate by, non-linguistic functions such as facial 
expressions and motions of the body (e.g., smiles and gesture) 

Q(CKH)— Qualitative Code Kinesthetic— ability to perform motor skills, or effect muscular coordination according to a recom- 
mended, or acceptable, form (e.g., bowling according to form, or golfirig) 

• Q(CP)— Qualitative Code Proxemics— ability to judge the physical and social distance that the other person would permit, 
between oneself and that other person 

Q(CS)— Qualitative Code . Synnoetics— personal knowledge of oneself 

Q(CT) — Qualitative Code Transactional— ability to maintain a positive communicative interaction which significantly influences 
the goals c the persons involved in that inleraclion(e.g., salesmanship) 

Q(CTM)— Qualitative Code Temporal— ability to respond to or behave according to lime expectations imposed on an activity 
by members in the role-sel associated with that activity 



II. Cultural Determinants \ 

There are thre6 cultural determinants of the meaning of symbols: i 

I — Individuality — uses one's own Interpretation at an influence on meanings of symbols 

A — Associates — symbolic meanings are influenced by one's peer group 

F— Family— influence of members of the family, or a few :.lose personal friends, on the meanings of symbols 



III. Modalities of Inference 

The third sei of cognitive style data includes elements that indicate the individual's modality of inference, i.e., the form of 
inference used: 

M— Magnitude— a form of categorical reasoning that utilizes norms or categorical classifications as the basis for accepting or 
rejecting an advanced hypothesis 

D— Difference— a tendency to reason in terms of one-to-one contrasts or comparisons of selected characteristics of 
measurements 

R— Relationship— the ability to synthesize a number of dimensions or incidents into a unified meaning, or through analysis of a 
situation to discover its component parts 

L — Appraisal — the modality of inference employed by an individual who uses all three of the modalities noted above (M, D, and 
R)# giving equal weight to each in the reasoning process 



ERJC 



Review of the Project Activities 

Project activities spanned two years. During the first year, 
measurement procedures were developed, faculty were 
trained, implementation plans were developed, and 
evaluation procedures fo- the implementation were 
designed. During the second year, the implementation 
plans were carried out and evaluation data were gathered, 
analyzed, and interpreted. 

In developing procedures for measuring educational 
cognitive style for this project, the initial step was to 
assemble a battery of measures parallel to those "used at 
Oakland Community College. To do this. Hill and selected 
members of the Oakland Community College staff 
reviewed existing assessment instruments at ACT and 
selected portions' of those instruments that could provicle 
the- most efficient measures of the various educational 
cognitive style elements. ACT instruments were used 
whenever possible because they are both nationally 
normed and nationally used. In instances where existing 
ACT instruments did not provide mea'-ujes of style 
elements, alternative instruments* were identified and/or 
developed. The measurement instruments were selected 
by Hill and several of his colleagues at Oakland Commu- 
nity College because of their expertise in the technical 
knowledge required to match some of the complex cogni- 
tive style dimensions with measurement instruments. After 
the individual measures for the various cognitive style 
elements were assembled into a battery, they were admin- 
istered on a pilot test basis, analyzed for psychometric 
properties, and revised to maximize the efficiency, relia- 
bility, validity, and objectivity of the assessment. 

Year one activities also included the training of partici- 
pating faculty. The training process began with orientation 
meetings with faculty at the two partirinating post- 
secondary institutions: Macumf> County Community Col- 
(MCCC) in Mt. Clemens, Michigan, and Michigan 
State University (MSU) in East Lansin[^ Michigan. These 
institutions participated in the project because both offer a 
full range of postsecondary programs to students who have 
a wide variety of backgrounds, goals, and aspirations. 
Evaluation of cognitive style in these contexts would maxi- 
miide the generalizability of results. In addition, these two 
institutions were* located in. relatively close proximity to 
Oakland Community College (OCC), thus allowing easy 
access of the project staff and participants to the best avail- 
able technical knowledge about cognitive style. The 
training process began with basic instruction on the 
conceptual framework of educational cognitive style and 
proceeded through six months of regular monthly, weekly, 
and individual meetings during which project staff 
members, Hill, and OCC faculty instructed the partici- 
pants on the' cognitive style mapping procedures. The 
training culminated with eight participants developing 
.^pians for the implementation oi the mapping procedures 
in iheir own instructional settings. Seven plans were 
developed, as two participants developed a joint plan. 



The implementation plans included provisions for evalu- 
ating the effect on educational outcomes of the use of 
educational cognitive style data and procedures. For each 
implementation setting, a study was planned to assess the 
relationship between the mapping of educational cogni- 
tive styles and student learning and attitudes. Procedures 
were also developed for the systematic assessment of the 
effect of implementation on the procedures and attitudes 
of participating faculty members. 

At the onset of year two (i.e., during the 1976 fall term at 
MSU and MCCC), participating faculty members put their 
plans into action. Project staff made periodic observations 
throughout the term to verify that implementation was 
carried out according to plan. Six of the seven plans were 
carried out. For each of these, evaluation data were 
gathered. These data and other data on teacher reactions 
and opinions were then analyzed and interpreted. 



Ewaluation Adwisory Panel 

Periodically during the planning and completion of project 
activities, project staff met and consulted with an Evalua- 
tion Advisory Panel. This panel of four educators provided 
fc/mative Input throughout the project and, in addition, 
provided expert judgment on. the meaning of the imple- 
mentation and evaluation data. Panel members were: Dr. 
Robert Birney, Vice President for Academic Affairs, 
Hampshire College, Amherst, Massachusetts; Dr. John E. 
Roueche, Professor and Director, Community College 
Leadership Program, University of ^exas, Austin,- Texas; Dr. 
Richard F. Snow, Professor ol^Education, Stanford Univer- 
sity, Stanford, California; and Dr. William F. Taylor, Dean of 
Students, Polk- junior College, Winter Haven, Florida. The 
panel met in formal session with project staff four times 
during the two-year project. In addition, panel members 
were consulted on an individual basis at various times 
throughout the project. Formal Advisory Panel reports 
were prepared and submitted to FIPSE at the end of each 
project year. Those reports are included in Appendix A of 
this report. Finally, panel members made recommenda- . 
tions and provided input for this final report of the project. 



Purpose oi the Report 

The primary purpose of this document is to provide a 
detailed record of the outcomes of the activities discussed 
above. A second purpose is to indicate the project staff's 
preliminary conclusions about the outcomes of the 
project— especially the potential- use of cognitive style 
mapping procedures for improving postsecondary educa- 
tibnal practices— and to summarize the staff's recom- 
mendations for continued exploration of educational 
cognitive style. 
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Overv/ew of the Report 

Each of the nextl three chapters of the report addresses a 
specific facet of the project from the perspectives of the 
project objectives, implementations, results, and recom- 
mendations. 

Chapter 2 deals with the training phase of the project. It 
des^^-'bes the faculty participants, the objectives of 
training, the instructional strategies used in training the 
faculty participants, and the (raining outcomes. 

Chapter 3 concerns the development and evaluation of the 
procedures/Instruments used to measure educational 
cognitive style elements. The development sequence is 
reviewed, the instruments are described, and the resuKs of 



a series of psychometric analyses of the instruments are 
presented. Technical issues associated with the measure- 
ment of educational cognitive style are explored. 

Chapter 4 addresses the effect of cognitive style mapping 
on educational outcomes in each of the implementation 
settings. Each implementation setting^is described, as is the 
evaluation design and the results of that evaluation. Gen- 
eral project-widie evaluation data are then presented and 
discussed. 

The fifth and concluding chapter provides a summary and 
an interpretation of project results. All conclusions are 
listed, and unresolved issues are reviewed. Finally, recom- 
mendations for future research and development are 
summarized. 



CHAPTER 2 



PARTICIPANT TRAINING 



A key:element in the study was the effective use of cogni- 
tive mapping procedures by faculty at the two pi^^tici- 
patjng institutions. Thus, a training prdgram was planned 
and conducted to provide faculty with d thorough knowl- 
edge of the conceptual framework of cognitive style, the 
individual style elements, and their uses in educational 
settings. The purpose of this chapter is to describe the key 
aspects of this training activity. 



Description of Trainees 

At the outset of the project, invitations were sent to a 
limited number of faculty at both MSU and MCCC inviting 
them to participate in the project. Those interested were 
encouraged to attend an introductory meeting; about 20 
persons did so. During the course of the project, changing 
responsibilities and conflicting work commitments 
resulted in the withdrawal of some of these volunteer 
participants from the project. Of the original grqup of 20, 8 
completed training, 4 each at MCCC and MSU. 

The participants from MSU included the Director of the 
University Counseling Center, the Director of Research for 
that unit, a faculty member in undergraduate teacher 
education, and a professor in graduate curriculum and 
Instruction. MCCC participants included a faculty member 
from the department of natural sciences, a physical educa- 
tion instructor, a humanities instructor, and the director of 
d program for students' with special academic and social 
needs. 



Training Objectives 

The overall purpose of the training program was to ensure 
that the participants understood and_, could apply the 
cognitive styJe elements and the process of cognitive style 
mapping in the educational context. To accomplish this 
purpose, seven training objectives were identified. Upon 
'completion of the training, each participant was to: 

1. understand the conceptual framework for educational 
cognitive style rnapping; 

2. understand the definitions of the cognitive style 
elements and identify corresponding bahavioral 
patterns in students; 
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3. understand and interpret the data yielded by adminis- 
tration of the. Educational Cognitive Style Test and 
Inventory; 

4. empirically map a subject by using observation and 
discussion and by adapting the cognitive style data gen- 
erated by the inventory to accommodate the behaviors 
the student exhibited in particular situations; 

5. diagnose probable mode of understanding (elenients of 
cognitive style crucial for successful completion of a 
given instructional task); 

6. understand his or her own cognitive style; 

7. develop strategies for using cognitive style .mapping 
procedures in his or her own educational setting. 

Attainment of the first objective was essential to the 
accomplishment of all of the other objectives. Once the 
participants were knowledgeable about the conceptual 
framework for educational cognitive style mapping, they 
then learned definitions for the individual style elements 
and how to translate student behaviors into these style 
elements. This satisfied the second objective. The third 
objective required participants to acquire the ability to 
accurately interpret the dat<^ resulting from' the Educa- 
tional Cognitive Style Test ind Inventory. These data were 
reported in the form of computer-generated cognitive 
style map. The process of literally translating test data into a. 
written map is called mathematical mapping. 

Cognitive style mapping involves much more than an inter- 
pretation of the mathematical map. It also includes the use 
of information about the student obtained by the teacher 
through observation and conversation. The combined use 
of test and observational data ^in determiriing cognitive 
style is referred to as empirical mapping. The fourth objec- 
tive of the training program was to teach participants to 
map style empirically. Empirical mapping was stressed in 
the training program as one of the most crucial skills the 
participants needed tcT acquire. Although mathematical 
mapping, results in. a useful profile of a student, empirical 
mapping allows the educator or counselor to alter the 
cognitive style map to reflect a student's preferences or 
attitudes in a particular"" context; Consideration of the 
context within which a map-iis interpreted (e.g., the par- 
ticular educational task and setting) is crucial to valid use of 
the map. 
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Th« fifth objective involved training the participants to 
di?» >e the critical elements of cognitive style necessary 
tor a tjdent to successfully complete a given instructional 
task. Once these critical elements of cognitive style are 
diagnosed, educational materials/methods that match the 
student's cognitive style can be assigned. Alternatively, the 
instructor may assign materials/methods which are 
intended to expand or augment the student's style. The 
instructor or counselor must continuously monitor the stu- 
dent's progress -and coordinate instructional materials/ 
methods with the style the student exhibits in changing 
educational contexts. Empirical mapping can play a crucial 
role in this process. 

The sixth objective was for the participants to identify and 
understand their own cognitive styles and the implicatioiiS 
of their styles for teaching, counseling, and administrative 
functions. Each participant took the Educational Cognitive 
Style Test and Inventory and was then involved in a step- 
by-step interpretation of the elements contained in the 
map. This self-knowledge facilitated the participants' 
understanding of the potential differences between them- 
selves and'their students, and of the need for reconciling 
the differences in planning instruction. 

Participants attained the seventh and final objective bv 
developing implementation plans for applying cognitive 



style n.^pping procedures in their own educational 
settings. They formulated plans by integrating formative 
input from project staff with the knowledge and skills 
gained through the training process. 



Training Strategies 

Participant training was coordinated and conducted by a 
full-time project staff member who had extensive training 
ir and experience with mapping and using educational 
cognitive style. This experience included planning and 
participating in workshops on cognitive style throughout 
the country. Hill also played a major role in the training 
process by presenting lectures and seminars and by 
working on a one-to-one basis with trainees. 

A variety of instructional methods— including lectures, 
small group discussions, seminars, simulations, films, and 
individual meetings— were used to help the participants 
achieve the seven training objectives. In addition, the 
participants were given reading materials and take-home 
assignments. Training sessions were held at each institu- 
tion to'accommodate local scheduling needs. The particu- 
lar methods used to achieve each of the seven objectives 
are indicated by Xs in Table 2.1. 
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Two of the five instruaional methods, small-group discus- 
sions/seminars and individual meetings, were used in 
achieving each of the seven objectives. Lectures were used 
frequently to accomplish six of the seven objectives. 
Simulation techniques were used to accomplish five of the 
objectives. Participants were paired so that each person 
could empirically map his/her partner. The end result was 
a partial profile of each participant derived through 
observation and discussion with that person. Finally, a film 
was used once during the orientation session. Staff from 
Oakland Community College who were skilled in the use 
of educational cognitive style mapping also assisted in the 
training process. 

One of the most difficult training objectives to accomplish 
was the mastery of the language specific to educational 
cognitive styfe. To ease this difficulty, participants were 
deliberately placed in training situations wherethey had to 
use the language. This technique, combined with the use 
of flash cards and other devices, eventually proved 
successful. 



Evaluation of Training Procedures 

Four major evaluation activities were conducted to help 
determine whether the training procedures were success- 
ful. First, at the end of the initial six-month training 
sequence, che participants received a questionnaire asking 
them whether they felt comfortable and competent in 
using information contained in a cognitive style map. 
Those participants who responded negatively received 
individualized training during the summer prior to imple- 
mentation. 

A more formal evaluation activity was .conducted at. the 
end of the first year. Each participant was given five cogni- 
tive style maps to review and was asked to provide written 



interpretations of the maps. Project staff rated these inter- 
pretations on a scale from 1 (low) to IC (high); the rating 
yielded a score reflecting the participant's ability to inter- 
pret maps. Each participant demonstrated a high level of 
performance. 

The third activity was an evaluation of the degree of com- 
petency and understanding demopstrated by participants 
in the design of their implementation plans. Concep- 
tualizing and designing an Implementation plan required a 
fundamental understandings of the cognitive style process 
and language. Participants developed seven plans, each of 
which exhibited the required understanding. 

'^The final evaluation activity occurred at the end of the 
project. Participants were asked to judge whether they had 
been adequately trained for effectively Implementing the 
mapping procedures. All participants responded affir- 
matively. 

Conclusions about the Training Procedures 

Project staff, consultants, and -participants agreed at the 
beginning of the project that a meaningful and objective 
evaluation of the effect of cognitive style mapping "bn 
students' learning would be possible only if knowledge- 
able and well-irained instructors implemented the 
mapping ^procedures. Consequently, participants com- 
pleted a.T extended period of training carefully geared 
to the accomplishment of specific training objectives. The 
end result was a group of , participants well founded in 
cognitive style mapping. These educators successfully com- 
pleted objective assessments of their competence; experts 
in educational cognitive style.attested to their level of com- 
petence; and the trainees themselves reported that they 
were confident of their knowledge 9/ the cognitive style 
procedures. Thus, the training phase of the project was 
judged highly successful. 



CHAPTER 3 



DEVELOPMENT OF COGNITIVE STYLE MEASURES 



A principal goal of the project was to develop and refine 
measures of the various dimensions of educational cogni- 
tive style. These measures were to be jsed'in mapping 
. students' cognitive style and in evaluating the impact of he 
use of cognitive style maps on educational outcornes. This 
chapter describes the specific objectives, procedures, and 
results of that effort. 



Objectives of the Instrument Development Phase 

The primary objective of the instrument development 
phase of the project was to select existing Instruments or to 
develop new instruments^.for assessing the-32 cognitive 
style elements (see Table 1.1, pp. 2-3). A second objective 
was to administer the instruments to a group of students in 
order to carry out a comprehensive .technical analysis of 
the efficiency, objectivity, reliability, and validity of the 
measures. • , 

The paper and pencil instruments themselves constitute 
but one step in the mapping of cognitive style — that is, the 
mathematical mapping process. A second step In cogni- 
._tive style mapping, empirical mapping, is the process of 
/generating a cognitive style-map on the basis of subjective 
assessments of student char'acteristics resulting' from 
conversations with and direct observations of the student. 
Due primarily to the complexity of the empirical mapping 
process, it was not studied In detail In this pr-oject. Rather, 
all the description and technical analyses reported in this 
chapter address mathematical mapping. Research should 
be conducted on the empirical mapping process itself, 
since It is a key eliement of the mapping process. 



Instrument Development Procedures 

The two project objectives related to Instrument devel- 
opment were achieved by carrying out the following steps: 

Step 1, Copies of the measurement instruments available 
afACT were provided to the educational cognitive 
style specialists on the OCC staff, who identified 
those style elements that^ could be effectively mea- 
sured by the instruments. The OCC staff also identi- 
fied for adaptation OCC-originated instruments 
if^that measured style element's that could not be 



assessed by the ACT instruments. OCC had previ- 
ously developed/assembled a battery of instru- 
' ments for measuring the cognitive style. elements. 
The battery had been' extensively used in numer- 
ous contexts. • >: 

Step 1 was carried out early ir »he first year of the.prbject. 
OCC staff were uniquely knowledgeable of what consti- 
tuted- appropriate measures for the very complex and' 
highly specialized set of variables that comprise the cogni- 
tive style map. Existing ACT instruments included mea- 
sures consistent with'the Hill conceptualization of-cogni- 
tive style — aptitude measures, preference measures, and 
attitude measures — and therefore servedas the core of the 
cognitive style measurement instruments. / 

Step 2. The selected or '- adapted instruments were 
assembled into a battery ^pd administered to a 
group of students (n = 135)' on a pilot basis at MSU 
and MCCC for the purpose of analyzing 'the relia- 
bility and efficiency of the measures.^ 

This step, also carried out during the firsPyear of the 
project, identified any obvious inadequacies In the assess- 
ment procedures, so that refinements and adjustments 
could be made prior to project implementation during 
year two. In addition, this pilot testing aided in training the 
participants by giving them experience in adminlsteririg 
and ir^terpreting the assessment battery. 

Step 3, The revised battery was administered at MSU and" 
MCCC (n=^258), and the data were subjected to a 
comprehensive technical analysis from various per-, 
spectivcs, including efficiency, objectivity, relia- 
• ■ ■ bility/and intercorrelations, among measures. 

Step 3, carried out during the second ye'ar of the project, 
documented the psychometric characteristics of the mea- 
sures related to the elements of the educational cognitive 
style map. The data were also used to evaluate the con- 
gruence between the measures and the various cognitive 
style elements. 

Step 4. Several major components of the cognitive style 
battery assembled .specifically for the project and 
.the original OCC-developed. battery were admin- 
istered simultaneously to a group (n = 93) of stu- 
dents at MCCC. 
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This step also took place during year two. It provided a 
basis for a systematic evaluation cf the concurrent validity 
of the measures selected or adapted by the OCC staff for 
the project. The question addressed was whether the 
project battery assembled by educational cognitive style 
experts yielded measures of the individual style elements 
comparable to the OCC measures. 



Outcomes of Instrument Development 

instrument Assembly 

The first four columns of Table 3.1 and all of Table 3.2 
indicate the linkage between the project measures and the 
individual cognitive style elements. The first line of Table 
3.1, for example, indicates that the Language Usage Test of 
act's Career Planning Program was judged appropriate to 
measure the Theoretical Visual Linguistic (TVL) style 
dimension. 



Results of the Preliminary Technical Analysis 

The reliabilities of instruments in the preliminary version of 
th^ Project Cogr.itive Style Test, and Inventory are listed in 
Table 3.1. All instrurriCiits (except the Inventory of Pref- 
erences' used to measure Cultural Determinants- 
addressed below) yielded appropriately high internal con- 
sistency reliability estimates. 

The data also show that the initial battery required 156 
minutes to administer. In an effort to reduce the amount of 
testing time, three changes were made in the research 
battery: (1) the two math tests in the original battery were 
equated to .eliminate redundancy; (2) a different, shorter 
reading test was adopted; and (3) the mechanical reason- 
ing test was shortened by one-half. The resulting battery 
required only 109 minutes to administer. 



Results of the Final Technical Analysis 

The data resulting from administration of the battery, in 
year two of the project were used in a second technical 
analysis of the instruments. This s(>tond analysis included 
the de^ermination both of internal consistency reliability 
estimates for the measures and of a matrix showing coeffi- 
cient correlations b.etween the various measures. The relia- 
bility estimates are reported on the right side of Table 3.1. 
They are all slightly lower than previous estimates, but are 
within acceptable limits with the exception of the measure 
of Cultural Determinants. 



One obvious reason for the low reliability estimates of the 
Cultural Determinant scales is the length of the scales. A 
10-item instrument with a reliability around .55, if extended 
to 20 to 40 items, would yield a reliability estimate of .70 to 
.85, a range.comparable to that of other instruments in the 
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battery. Therefore, the instrument was retained and used 
during the project in spite of the relatively low reliability 
. estimates. 

The matrix of intercorrelations is Reported in Table 3.3. 
Several conclusions can be drawn frqm these data. First, 
with one notable exception, the various dimensions of 
style appear to be statistically independent. The exception 
is the relationship between Theoretical Visual Quanti- 
tative (TVQ) and Theoretical Auditory Quantitative (TAQ). 
The correlation between TVQ and TAQ is .69, which verv 
nearly approximates the reliabilities of the two instru- 
ments. This correlation suggests that these supposedly 
independent style elements cannot be reliably differ- 
entiated on the basis of the particular measures provided in 
the battery. TVL is defined on page 2 as the "ability to find 
meaning in written words." A high score in this area 
indicates someone who reads with better than average 
comprehension. Yet, the correlation between, the TVL 
measure selected by the OCC staff team and the standard- 
ized reading test is only .51. Further discussion of this point 
with specialists in educational cognitive style revealed that, 
"conceptually, TVL includes verbal reasoning and grammar 
in addition to reading. These additional factors are covered 
by the language usage test included in the cognitive style 
battery. . 

Finally, of the many Inventory of Competency scales in 
fable 3.2 identified with the various Qualitative Symbol 
elements, scales said to measure the same style element are\^ 
uncorrelated. Such an outcome is contrary to expectation, 
given the traditional definition of construct validity. 



Results of the Coadministration of OCC and Project 
Batteries 

To further investigate; the validity of the project cognitive 
style measures, a subset of the OCC-generated and the 
project cognitive style measures was administered simul- 
taneously to a group of 93 students:- The relationships 
among nine Qualitative Symbol scores, three Cultural 
Determinant scores, and four Modalities of Inference 
scores resulting from this coadministration were deter- 
mined, and are reported in Table 3.4. The median corre- 
lation between independent measures of the same 
element over the 16 elements is .06. The correlations range 
from -.17 to +.19, revealing a high level of statistical 
independence. 

As a final step'in this search for relationships between the 
OCC and project measures, more intensive analysis was 
* conducted of the relationship between Inventory of Com- 
petency scales and OCC measures of selected style ele- 
ments. The bCC staff members involved reviewed the 
scales associated with each style element and identified the 
one scale oi those listed that was most similar to the OCC 
measure of the same style element. The results, of that 
correlational analysis are reported in Table 3.5. Once again. 
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battery. Therefore, the instrument was retained and used 
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. estimates. 
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TABLE 3.2 



Relationships between Style Elements 
and Inventory of Competencies 



Style Element 



Corresponding Competency Scale^ 



Qualitative Symbols 
Auditory 
Olfactory 
Tactile 
Visual 

Proprioceptive 
Fine 

Kinematic Gross 
I Temporal Gross 
Proprioceptive 
Gross 

Kinematic . 

Temporal 
Empathetic 
E5.thetic 
Eti>ic 

Histrionic 
■ Kinesics 
Kinesthetic 
Proxemicls 
Synnoetics 
Transactional 
Temporal 



Trade, BD 
Trade 

Trade, Tech, Arts, BD 
Trade, Tech, SC, Arts, SS, BD 

Trade, Tech, SC, Arts, BC, BD 
BC 

Trade, Arts, BC, BD^ • 

Arts, BC 

BC 

BC 

SS, BC 

Trade, Tech, SC, Arts, SS, BC, BD 
Trade, Tech, SC, Arts, SS, BC, BD 
Trade, Arts> SS, BC, BD 
Arts, SS, BC ' , 

Trade, Tech. SC, Arts, SS, BC, BD 
SS, BC 

Trade, Tech, SC, Arts, SS, BC, BD 
SS, BC 

Arts, SS, BC, BD 



Modalities of Inference 
■ Magnitude 

Difference 

Relationship 

Appraisal 



Trade, Tech, BD 

Arts 

SS, BC 

SC, Mechanical Reasoning Test 



'*^BC = Business Contact.^ BD =^ Business Detail; SC = Science; 
SS = Social Service; Tech = Technical. 



TABLE 3.3' 

Intsrcorrelations among Tests and Subscales Contained in the 
Project Cognitive Style Test and Inventory Booklet 
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Note: KR..or roef alpha reliabilities are on diagonal. 



TABLE 3.4 



Results of Coadministration of 
OCC and Project Cognitive Style Batteries 



OCC Project 

Style Element Correlation X Decile S.D. XDec.e S.D. 



Qualitative Symbols 

Empathetic -.06 6.25 .1.90 6.77 2.40 

Esthetic .02 6.09 2.01 8.33 1.26 

Ethic ^ -.05 6.04 2.05 8.32 1.26 

Histrionic .17 5.36 1.82 7.98 1.62 

Kinesics .07 5.17 1.79 7.25 .1.89 

Kinesthetics .19 * 5.30 1.83 8.32 1.26 

Proxemics .13 5.01 1.64 6.77 2.40 

• Synnoetics .13 6.44 1.43 3.33 1.26 

Transactional • -.05 5.53 1.65 * 6.77 2.40 

Cultural Determinants 

Individual ' .06 5.77 1.26 5^23 ' 1.52 

Associate >r.17 3.45 0.95 4.51 1.37 

Family .06 3.87 1.16 4.23 1.40 

Modalities of Inference 

Magnitude .05 4.00 1.34 ^ 7.83 1.49 

Differenc-e ' .08 > 2.98 * 1.89 5.48 2.13 

Relationship .06 3.41 1.08 6.78 2.40 

Appraisal .03 4.93 1.27 5.84 2.76 



TABLE 3.5 

Correlations between DecHes on inventory of Competency Subscales 
and Decile Value for Selected Qualitative Symbols 
as Measured by the OCC Cognitive Style Battery 



^ . ' OCC Measure ■ 

Pfoject ■> 

Measure * CES CS GET CT CH CK CKH GEM GP 



TR 


-0.12 


0.12 


-0.14 


o.bo 


-0.22 


-0.00 


0.01 


-0.12 


-0.13 




-0.13 


0.07 


-0.05 


0.11 


0.00 


-0.12 


0.12 


-0.03 - 


/ -0.02 


SG 


O.Oi/ 


0.14 


-0.093 


0.14 


-0.17 


0.07 


0.07 


-0.03 


0.02 


AR 


0.103 


0.01 


-0.15 


0.06 


_ -0.01 3 


0.113 


. 0.263 


. -0.01. 


0,01 


SS 


0.08 


0.103 


-0.00 


0.173 


0.02 


-0.04 


0.11 ' 


-0.01 


0.09 


BQ 


-0.02 


0.08 


-0.04 


-0.05 


0.05 


0.01 


0.07 


-0.1J.3 


0.063 


BD 


-0.10 


0.11 


0.05 


-0.00 


0.13 


-t).06 


0.04 


-0.04 


0.17 



^Indicates the best possible match between the OCC measure and competency scale according to educational cognitive style specialists. 
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a universal lack of relationship between project measures 
and OCC.,measures was revealed. Even those measures 
which were a good match' conceptually proved statistically 
unrelated. Clearly the OCC measures and the project 
measures seleaed by OCC staff were not tapping the same 
student characteristics. 



Summary of Instrument Development 

The project objectives regarding instrument development 
were: 0) to develop measures of the style dimensions and 
(2) to field test those measures in ord^r to conduct a 
comprehensive analysis of their psychometric character- 
istics. Both objectives were achieved. Participating OCC 
staff assembled a battery of instruments intended to 
measure the 32 dimensions of style, and that battery was 
administered and twice analyzed. 



These analyses yielded the fpllowing conclusions: 

1. The battery could be administered in a relatively short 
period of time (usually less than two hours) and could 

, yield a great deal of data. Therefore, it was efficient. 

2. With the exception of the measure of Cultural Deter- 
minants, the measures were found to be sufficiently red- 
able for purposes of the study. The deficiency in the 
Cultural Determinants measure was considered 
correctable. 

3. High intercorrelatipns for some of the measures 
suggested some redundancy in the instruments. 

4. Intercorrelations among independent measure*, of 
. some of the cognitive style dimensions revealedflan 

absence of construct validity among the measarest 

The problem of validity as it relates to the ability to inter- 
pret the research results is addressed in the introduction to 
Chapter 4. 



CHArfER4 

THE RELATIONSHIP BETWEEN THE USE OF EDUCATIONAL. 
COGNITIVE STYLE MAPPING AND EDUCATIONAL OUTCOMES 



lin'pleinenUtion Goals and Strategies 

Another primary goal during the first year of the project 
was, for participants to' develop detailed plans for imple- 
menting. the cognitive style mapping process in their own 
instr-uctional settings. Each plan contained three parts. First, 
the overall goal of the implementation was described in 
terms of a mission statement.* Second, the major objectives 
were described in terms of , design criteria. Finally, the 
procedures to be used in achieving the objectives were 
described asVperformance goals. Collectively, these three 
parts formed a comprehensive description of the imple- 
mentation procedures to be carried out by each partici- 
pant during the second year of the project. 

. Rarticipantsjormulated their implementation plans over a 
period of three months. A total of seven plans were 
developed: four by staff at Macomb County Community 
College and three by staff at Michigan State University. The 
prlrnary instructional and evaluation objectives of each 
setting are outlined in Table 4.1. These objectives were 
achieved in six of the seven implementationr settings. 
Implementation was not successfully carried out at the 
MSU Counseling Center, where local conditions made it 
impossible to complete the plani. 

Implementation of plans in the remaining six contexts per- 
mitted exploration of the impact of educational cognitive 
style mapping on approximately 250 'students of diverse 
backgrounds who were striving to achieve a wide range of 
educational goals. This chapter describes each imple- 
mentation setting and the evaluation methodology used in 
each setting to explore impact; it also presents and inter- 
prets the results of the evaluation. In addition, following a 
review of the implementation settings, the results of struc- 
tured teacher debriefing interviews and student attitude 
surveys are presented. 



Alternative Perspectives on the Interpretation of the 
Implementation Results 

For any study involving an assessment component, the 
validities of the instruments used are crucial to the inter- 
pretation of the results. If the instruments lack validity for 
the context in which they are used, the meaning of the out- 
comes of the^ study as measured by those instruments will 



be confounded. Therefore, a basic question concerning 
the instruments used in this study is: What constitutes an 
appropriate indicator of validity of the cognitive style 
measure? 

The data reported in the previous chapter suggest that the 
particular instrumerits assembled for this study lack con- 
struct validity, whidli is a type of validity some researchers 
feel is essential in a study of this type. However, there are 
other researchers who view construct validity as second- 
ary. Among those researchers who hold this alterna'tive 
view, there is a large number who rely heavily on the 
content and face validity of measurement instruments. - 

This validity distinction is important in this study because 
the measurfi ^re used only to generate a mathematical 
map of inuividuals' cognitive style attributes. Hill's model 
does not sltop with the mathematical map, but rather 
requires an empirical mapping of cognitive style attributes 
that combines relevant data from the mathematical map 
with all other aypes of data (e.g., the instructor's knowl- 
edge of an individual's prior experiences and information 
generated through direct contact between the instructor 
and the student). Such an approach relies on the data gen- 
erated frotn the cognitive style measures to provide a point 
of departure, rather than an end point, for determination 
of an individual's cognitive style. 

The. cognitive style instruments used in this study were 
assembled by experts knowledgeable about the nrieaning 
of each of the cognitive style elements; these experts \yere 
confident that the various instruments provided adequate 
measures of the cognitive style elements from a content 
perspective. Therefore, there is strong reason to believe 
that the measures do have both face and content validity. 

The preceding points should be considered by those who 
would conclude that the results of this study provide 
definitive evidence on the effect of cognitive style 
mapping in educational contexts similar to those at MSU 
and MCCC* No such conclusion can- be made solely on the 
basis of this.study by xhoie who would require that the 
measures must possess construct validity because^ the 
evidence collected does not warrant such confidence in 
the instruments used. However, for those who are satis- 
fied that the instruments possess sufficient content or face 
validity and that this type of validity is most crucial, the 



TABLE 4.1 
Sunimary of Implementations 



Implementation 
Context 



MCCC Science 



MCCC Humanities 



MCCC Special Needs 



Instructional 
Objective 



Tailor instructional materials to 
individual student styles 



Offer a variety of instructional treatments 
to students'to meet the demands of' 
various students' styles 

Provide preenroliment remediation to 
st;udents with special academic needs 
using cognitive style oriented instruction 



Evaluation 
Objective 



Assess impact of tailored instruction in 
academic^and attitude outcomes compared 
to traditional instruction 

Assess the importance of match between 
student style and instructional method 
in predicting course outcomes 

Evaluate the impact of special treatment ^» 
in postenrollment educational performance 
compared to previous groups 



MCCC Physical 
Education 

MSU Educational 
Psychology 



MSU Graduate 
Curriculum Course 



MSU Counseling 
Center 



Differentiate successful from unsuccessful 
golfers on the basis of style elements 

None 



Instruct students assigned to one of two 
instructional treatments designed to match 
their style 

Conduct career/vocational counseling using 
information on style as a basis for the 
counseling process 



Assess the reliability of the differentiation 



Evaluate the correlation between student- 
teacher style match and instructional 
outcomes 

Assess degree of match between student 
style and treatment style and compare 
group performance 

Compare counseling dutcomes achieved 
both with and without information about 
counselor's style 



results offer more substantive evidence on the issues 
addressed oy the study. 

The results of this study reflect only>the relationships 
between educational cognitive style as determined in this 
study (combining both mathematical and empirical 
mapping as proposed by .Hill) and the outcomes resulting 
from the implementations carried out. Additional research 
is needed to address issues and questions on the potential 
in education for other conceptual models of cognitive 
style. 

Implementation in a Science Course 

Description 

Tvvo science classes (experimental and control) with equal 
mean course pretest scores were formed at MCCC. Each 



class was then randomly divioed in half. Altliough all 
students in each class took the Educational Cognitive Style 
Test and Inventory, only half the members of each class 
received map interpretations of their style. The control 
class was taught using a traditional approach; the experi- 
mental class was given prescriptive instruction. Students in 
the experimental class whose maps were interpreted 
received prescriptions based on their mathematical cogni- 
tive style maps. Students in the remaining half of the class 
were randomly assigned individual prescriptions for. 
learning. 



Evaluation Methodology 

Two analyses were performed on the resulting science- 
related data. First, the average class test performances for 
the students in the traditional and prescriptive instruction 
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classes were compared by means of an analysis of covari- 
ance procedure that took into account the. students' 
entering ability level, this procedure was also used to 
investigate the impact of map interpretation and instruc- 
tion on final average in science class and to study the inter- 
active affect of method of instruction and receipt of map 
interpretation. Second, the dropout rate for the students in 
each of the two classes was com^ jred to the average 
dropout rate, and the dropout rate tor the prescriptive 
class was also compared to the average dropout rate f6r 
three traditional science classes taught the same semester 
by the same instructor. 

There w^re two > important limitations in the science 
evaluation. The instructor may have biased the control 
^treatment by empirically (subjectively) mapping students 
who should have been randomly assigned a prescription 
forlear.ning. For some of these students, then, the prescrip- 
tions may have been partially based on empirically mapped 
cognitive styles rather than randomly assigned. Further, 
those students who received prescriptions based on their 
cognitive styles were permitted to self-select any other 
materials they wished. This tainted the experimental 
condition. 



Results 

7. Final Average. Table 4.2 summarizes the final grade 
averages of the- two instructional groups involved in the 
science implementation. The mean grade average fui the 
students in the prescriptive (experimental) class was higher 
than that for the students in the traditional (control) class. 
The mean for the students in the prescriptive class who 
received map interpretation was slightly lower than the 
mean for students in the same class whose prescriptions 
were not based on their cognitive style maps. It is not 
possible to determine at this point whether the improve- 
ment in final grade average for the prescriptive class was a 
function of the experimental nature of the individualized 
instruction or of the impact of cognitive style map inter- 
pretation and instruction, although the former interpreta- 
tion seems more likely. As further support for this inter- 
pretation, the analysis of covariance results shown in Table 
4.3 identifies a significant instruction effect, but not a 
significant interaction effect. 

In order to further investigate the implementation and 
nature of the instruction, a special set of interview ques- 



TABLE 4.2 

Final Average for Students in the Science, MCCC Clas^ 



Interpretation 



yes 



no 



Total 



Instruction 



Prescriptive 


Traditional 


75.4 


71.1 


(n = 12) 


(n = 12) 


76.5 


68.5 


(n = 15) 


(n = 10) 



76.0 



69.8 



Total 
73.2 

72.5 



TABLE 4.3 
Summary Table 
Analysis of Covariance 



Source 


df 


SS 


F 


P 


Pretest 


1 


V 2166.05 


18.86 


0.0001 


Interpretation 


1 


0.37 


0.00 


0.9546 


Instruction 


1 


1028.77 


8.96 


0.0045 


Interaction 


1 


50.78 


0.44 . 


0.5096 


Error 


44 


5054.67 
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lions was developed for the mslructor to answer. The 
answers suggest that the students who received both map 
interpretations and prescriptions based on their cognitive 
styles were free to vary from and ati' >^n{ their prescrip- 
tions as they desired. The same wab true for the students 
whose prescriptions we^e not based on their cognitive style 
maps. There Is some reason to believe that the Instructor 
.miay have assigned these students prescriptions on the basis 
of her assessment of their cognitive style, rather than 
randomly as was called for In the experimental design. 
Answers to some of the questions in the Interview suggest 
that the students In the prescriptive class were aware of the 
nature of the experiment and had been advised that they 
were the group for which large gains In performance were 
expected. 

2. Dropout Rate, Table 4.4 displays the number of students 
who withdrew from each class before the end of the 
.semester. The analysis of this difference in dropout pattern 
' between the two classes yielded a X" value of 5.11 , which Is 
significant at the .05 level. 



A total of nine students dropped out of the two classes; 
seven of these were In the traditional class. The two 
students in the prescriptive class who did not complete the 
semester both received individualized instructional 
prescriptions based on their cognitive style maps. 

Duririg the fall semester, the Instructor taught two science 
classes In addition to the two classes Involved In this experi- 
ment. A traditional Instructional approach was used in both 
classes. For the three classes taught using traditional tech- 
niques in the fall 1976 semester, the average dropout rate 
was 30 percent. When the 7,4 percent dropout rate for the 
prescriptive class is compared to the mean dropout rate for 
the traditional approach, the difference is statistically 
significant at the .05 level. |t would appear, therefore, that 
there was a relationship between the method of instruc- 
tion and the dropout rate of students in the science classes. 
Furthermore, that relationship, which favors prescriptive 
instruction, does not appear to be influenced by the^way 
the prescription was determined. 



TABLE 4.4 

Comparisons of Number of Student Dropouts in Prescriptive and 
Traditional Classes and Who Did or Did Not Receive Map Interpretation 



Instruction 





Prescriptive 


Traditional 


Total 


yes 

Interpretation 

no 


2 


1 


3 


0 


6 


6 


Toral 


2 


7 


9 
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Interpretation of Results 

The impact of the instructional method is apparent in 
each of the sets of data analyzed. The prescriptive instruc- 
tional method, whether or not the map was used, pro- 
vided more positive results in the academic, retention, and 
attitude outcomes than npnprescription instruction. 
Students in the ■ prescriptive class achieved an average 
grade significantly higher than that of the students in the 
traditional class. However, compared to the random 
assignme'ht of a prescription for learning, the effect of map 
interpretation on the academic outcornes, as measured by 
final course test av^?^'age, wasTJOt substantial. The reten- 
tion rate was significantly higher for students in the 
prescrrptive class than tor students in the three traditional 
science classes taught by the same teacher the same 
semester. Within the traditional setting, there was a 
tendency for those students who received map interpreta- 
tions to remain in the class throughout the semester. 



cognitive style elements and the scores on those elements 
that the student should have achieved to maximize the 
chances of fl) profiting from the instruction presented and 
(2) succeeding in the class.' Four sets of match scores— one 
set for each of the probable modes of understand- 
ing—were calculated for each student enrolled in a 
humanities class in fall 1976. Match scores were calculated 
for the elements in the method's probable modebf under- 
standing map. Since there are 15 elements in the probable 
mode of understanding map for , the lecture method, 15 
match scores were calculated for every student in each 
humanities class. The formula used for the generation of 
match scores was the one recommended and used by Hill : 



1 -|XRj - XSjjI. 



'Implemenlalion in a Humanities Course 

Description 

The course instructor identified the pertinent cognitive 
style dimensions for each of three methods of presenting; 
course material— lecture, group discussion, and media— 
and specified the optimal level of performance for 

■ each selected element. The map elements and optimal 
performance levels ''for each method were assembled to 
form the "probable mode of understanding" optimal style 
for each approach. In addition, a probable mode of under- 
standing that included^, the common elements of the 
lecture, group discussion, and. media approaches was 
developed for the entire course. The correlation between 

.student style/mode match and course outcomes was 
evaluated. 



Evjluddon Mothodolo^y 

Student cognitive style maps were generated and 
compared with the probable mode of understanding 
(optimal map) for each method and the course as a whole. 
The match between tNo actual student map and the 
optimal or ideal was then used to predict the student's fjnal 
exam score. 



Results • 

Sludcni-to-lnstructional-Method Mdtch. The four instruc- 
tional .methods used to communicate the course mate- 
rial—lecture, group, media, and course— and their opti- 
mal decile level are shown in Table 4.5. This table lists the 



whereiXMjj = match score for element j for student j 

XRj = instructional approach (referent) optimal 
decile level for map. element j 

XS jj = student, decile value on map element j 



For each instructional method, two stepwise regression 
procedures were used to predict the same criterion score 
on the final exam. The first stepwise regression included 
decile scores on the mode of understanding and the match 
variables as [Dredlctprs, In a second analysis, the match vari- 
ables were used alone as predictor variables. A signifi- 
cance level of .lO was stipulated for each analysis. Tables 
4.6 and 4.7 show summaries of the results of the analyses. 
Included are the. regression equations obtained and the 
percent of variance accounted for by use of the appro- 
priate map deciles concatenated with match scores, and 
m.itrh scores on the appropriate map elements as 
predictor variables, respectively. 



For each of the stepwise regression equ^tio'ns, the percent 
of variance accounted for by ti^e predictor variables is less 
than 30. Fo pursue further the relationship between the 
predictor variables and the criterion, corr<e!ations were 
calculated and are presented in Tables 4.8 through 4.11 for 
the lecture, group, media, and course approaches, respec- 
tively. The,se tables indicate that, except for TAL and TVL, 
the correlations do not appear.to be diffe/ent from zero at 
the .05 significance level. 



' - TABLE 4.5 

Probable Mod^ of Understanding of 
Humanities Instructional Methods 



(1) Lecture/Discussion 



Sjyle element 


Percentile 


FR T(AL) 


80-89 


12 T(VL) 


70-79 


Q(A) 


70-79 


Q(CKHK 
Q(CES) 


80-89 
70-79 


Q'(CT) 


60-69 


Q'(CET) 


60-69 


Q'(CEM) • 


' 60-69 


Q'(CTM) 


50-59 


Q(CK) 


70-79 


1 


70-79 


A' 


60-69 




80-89 




, 60-69 




50-59 



(3) Media (Audio-Visual) 

Style element 
FR T(AL) 

Q(V) 
Q(A) 

q(ck:h) 

Q(CES) 
Q(CET) 
Q(CTM) 

I 

A' 



Percentile 
70-79 

80-89 
70-79 
^ 80-89 
70-79 
70-79 
70-79 

80-89 
60-69 



M 
R 



70-79 
70-79 



(2) > Group Activities 



Style element 


Percentile 


12T(AL) 


70-79 


10 T(VL) 


70-79 


Q(V) 


■ 80-89 


Q(CT) 


70-79 


Q(CES) , 


70-79 . 


Q(CEM) 


70-79 


Q(CS) 


70-79 


Q'(CET) 


60-69 


Q'(CH) 


50-59 


Q'(CK) 


50-59 


Q(CP) 


50-59 


1 


70-79 


A 


70-79 


F' 


40-49 



(4) Course Overall 

Style element Percentile 

12T(AL) 7a-79 

I ^ 70-79 

A ^ 60-69 , 

M . ^ 70-79 

Q(CES) 70-79 

Q(CET) ^ 60-69 



M 



80-89 
K 60-69 



TABLE 4.6 







Stepwise Regression. Equations Obtained by 
Using Appropriate Map Deciles and Respective 
^ Match Scores as Predictors 


Instructional 
Method 




prediction Equation 


Lecture 


.28 


' 32.01 + 1.00 (TAl) + 1.48 (TVL) -14.19 (match JVL) - 8.49 (A) 


Group 


.29 


37.04 + 1.07 (TAL) + 1.59 (TVL) - 16.86 (matcK'TVL) - 26.26 (match F) 


Media 


.07 


32.88 + 1.27 (TAL) - 13.34 (match A) 


Course 


.16 


30.15 + 1.27 (TAL) - 17.46 (match 1) ^ 



TAB1E4.7 . . 

Stepwise Regression Equations Obtained by 
Using Match Scores on Appropriate Map Elements as Predictors \ 



Instructional . 










Method 


R2 


Prediction Equation 






Lecture 


.21 


12.66 + 17.93 (TAL) + 


11.49 (TVL) H 


H 10.14 (R) 


Group 


.18 


10.74 + 22.80 (TAL) + 


11.50 (TVL) H 


h9.2^(Q(CP)) 

V 


Media 


.13 


18.5r+ 20.41 (TAL) + 


5.61 (TVL) 




Course 


.03 


34.45 - 25.21 (1) + 6.41 -(M) 





Interpretation of the Results 

■; ' ■ ^ , 

Attempts were made to use map deciles concatenated with 
appropriate match scores or match scores alcne to gen- 
erate a stepwise regression equation for predicting the 
score on the final examination f6r any of the instructional 
methods; these attempts failed. The small percent of 
variance accounted for by the regression equations is due, 
at least in part, to the nearly zero correlations between the 
majority of predictor variables and the criterion final exam- 
ination score. With the match criteria selected for this 
research, there was essentially no statistical relationship 
betwee;i the majority of the elements in the maps of the 

.methods of instruction and the final examination score. 
The language, area is the one instance whera there does 
seem to be some rdationship between test data and'courSe 
outcomes. TyL and TAi, which could be interpreted as 



measures of verbal scholastic aptitude, were found to have 
a nonzero correlation with humanities course grades'. 



Implementation in a Special Needs Setting 

Description • . 

MCCC offers preenrollment orientation classes for stu- 
dents whose probability of success at college is low. 
One objective of the orientation program is to build up the 
students* basic skills in order to improve their chanced of 
success once they enroll. This implementation called for 
the use of cognitive style information in choosing instruc- 
tional materials intended to help students develop in their 
basic skill areas. 



TABLt 4.8 

Correlations between Predictor Variables 





and Final Exam Score: 






Lecture Approach 








ividicn score 


Map Bement 


f^nrrolAtimi lA/itn 


v^orreiaiion wiin 






Criterion 


• TAL 


.405 


.394^ 


TVL 


.388^ 


.249^ 


1 


.110 


".177 


A 


-.065 


-.146 


M 


-.046 


-.014 




-.103 


.012 


R 


.008 


.071 • 


Q{A) 


. .008 


-.087 


Q{CEM) 


.008 


.070 


Q{LES) 


-.038 


-.049 


Q{GET) 


-;038 


-.063 


Q(CK) 


-.045 . 


.021 


Q(LKH) 


-.038 


-.042 


Q(CT) 


.008 


.070 


Q{CTM) 


-.034 


-.030 



^Significantly different from zero at a = .05 level. 



TABLE 4.10 
Ccjirrelations between Predictor Variables 
and Final Exam Score: 
' Media Approach 



Raw Score Match Score 

M^p Element Correlation with Correlation with 
Criterion Criterion 



TAL 


.405^ 


.352 


1 


.110 


.177 


A 


-.065 


-.147 


M 


-.046 


-.010 


R 


.008 


.053 


Q{A) 


.008 


-.087 


Q{V) . 


-.O^g 


-.050 


Q{CES) 


-.038 


-.050 


Q{CEf) 


-.038 


-.050 


Q{CKH) 


-.038 


-.042 


Q{CTM) ■ 


' -.038 


-.079 



^Significantly different from zerp at a = .05 level. 



TABLE 4.9 

Correlations between Predictor Variables 
and Final Exam Score: 
Group Approach 



Raw Score Match Score' 

Map Element Correlatiorc with Correlation with 
Criterion Criterion . 



.TAL 


.405 ^ 


.352^ 


TVL ^ 


' .388^ 


249^ 


1 


.110 


.177 


A 


-.065 


-.065 


F 


. -.041 


, .007 


M - 


-.046 


-.014 


b 


-.103 


.012 


Q(V) 


-.026 


-.050 


Q(CEM) 


.008 


.053 


Q{CES) . 


-.038 


-.049 


Q{CET) 


-.038 


-.063 


Q(CA) 


-.095 


.012 


Q(CK) 


-.045 . 


.005 


Q{CP) 


.008 


.071 


Q(CT) 


-.039 


-.049 


,Q(CTM) 


.008 


.053 



^Significantly different from zero at "5: = .05 level. 



TABLE 4.11 

Correlations between Predictor Variables 
and Final Exam Score: 
Course Approach . 





Raw Score 


Match Scori 


Map Element 


Correlation with 


Correlation with 




Criterion ^ 

-J- > 


Criterion 


TAL 


.405^^ 


.005 


1 


.110 


-.158 


A 


-.065 


-.035 


M 


-.046 


.095 


Q(CEsy 


-.038 


.044 


Q(CET) 


-.038 


.044 



^Significantly different from zero at <X = .05 level. 
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fva/uat/on Methodology 

s 

Two data sets were examined in order to ascertain the 
impact of incorporating cognitive style information in the 
orientation program,,of special needs students at MCCC. 
First, the academic progress of the 31 students in the 1976 
orientation class— students for whom cognitive style data 
were collected— was compared with the progress of the 66 
students in the 1975 orientation class— students for whom 
cognitive style data were not collected. Second, since 10 of 
the 31 members of the orientation class were retested on 
the Educational Cognitive Style Test and Inventory after the 
orientation program was qompleted, growth on the basic 
skill map elements was evaluated. 

There were two limitations in this evaluation. First, the year 
when instruction was received was totally confounded with' 
the treatment condition, since control and experimental 
treatments occurred in different years. Second, only one- 
third of the experirhental group participated in the retest 
to assess growth in basic skills. Therefore, the results may 
not be representative of the entire group. 



Results 

7. Academic Progress. A comparison was made of 'the 
indices of academic progress for the 1975 (control) arid 
1976 (experimental) orientation groups. The indjces 
included percent completing orientation, percent of those 
completing orientation who enrolled for credit, average 
number of credits attempted, average proportion of credits 
completed, and mean grade point average. The results of 
those comparisons are presented in Table 4.12. 

The results suggest that, although the sizes of the two 
groups differed greatly, the proportion of students in each 
group completing tine orientation program was constant. 
The principal difference between the groups was in the 
proportion of those completing orientation who actually 
enrolled for.college credit. A higher, proportion of 1976 
students (experimental) enrolled. However, although they 
enrolled for a slightly larger number of credits on the 
^avenge, they tended to complete a slightly smaller propor- 
tion of those credits and achieved slightly lower grades. 

A probable outcome of the incorporation of cognitive style 
information jn the orientation program of the special 
needs students, therefore, may have been an increase in 
the numbers of special- needs, students who enrolled in 
academic courses at MCCC. Since these students, on the 
average, had a lower grade point average than the 1975 
students, the use of cognitive style information during 
orientation may have given more confidence to the less 
able students and motivated them to proceed into course 
work. An interesting follow-up study would involve deter- 
mining whether these students who were less successful 
than their 1975 counterparts actually have pursued their 



academic prbgrams into subsequent terms. Such data are 
not presently available^* 

2. Growth in Cogn/t/ve Style Elements from September to 
December 7976. Of the 32 students in the orientation class, 
10 retested in December 1976. The small sample size for the 
retesting was a function of scheduling problems and 
student availability. As was noted above, this small volun- 
tary sample may not be representative'of the entire group. ' 

Table 4.13 shows the mean decile ranking for the two 
groups for each of the 32 rnap elements. Although, on the 
whole, the mean for the group tested in December was 
higher than the mean for the group tested in September, 
the question of growth is confounded by the selea. nature 
of the December cohort. To examine the issue of growth 
more fully, the five basic skill map elements of most impor- 
tance to this setting (TAL, TAQ, TVL, TVQ, and Reading 
Level) were compared for each of the 10 students retested 
to assess the change in scores between September and 
December. The results of this analysis are presented in 
Table 4.14. Grade level norms are reported for the Theo- 
retical Symbols and Reading Level. An increase from 
September to December^testing was defined as a change \p 
grade level score of one year or more (about two standard 
errors of measurement). A decline was defined as a 
decrease in performance reflected by a one year or more 
drop in grade level score. All.other changes in scores were 
reportied as no change. Of the 50 possible score increases, 
10 actually occurred. Theoretical symbols TVL and^TVQ, 



TABLE 4.12 

Comparison of Special Meeds Students' Academic 
Progress for 1975 and 1976 Classes 





1975 


1976 


Number scheduled to begin 
orientation 


66 


31 


Number completing 
orientation ^ 


56 (85%) 


25 (81%) 


Number of those completing 
orientation who enrolled for 
credits 


39 (70%) 


23 (92%) 


Mean number of credits 
attempted 


11.2 


11.5 


Mean proportion of credits 
completed 


63.0 


60.9 


Mean GPA 


2.09 


1.94 
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and Reading Level were the map elements indicating 
grovs^h for some students. T^n percent of the scores 
showjpd decline in performance from September to 
December; TAL andTVL were the map elements on which 
some decline was noted. Seventy percent of the scores 
from the two testing experiences differed by less than one 
grade level. Since no data were available on the normal 
growth experienced by the special needs students after the 
orientation program, no determination could be made of 
the extent to which the cognitive style implementation 
impacted growth. 



TABLE 4.13 

Comparison of Map Results for Original 
Croup of Students and a Subset of Those 
Students Who Were Available for 
Retesting in December 1976 



Mean Pecile 



Map Element 


September 


December 




(n = 32) 


(n = 10) 


TAL 


4.5 


4.5 


TAO 


2.8 


3.6 


TVL 


4.6 


3.1 


TVQ 


3.9 


5.0 


Q(A). 


7.1 


7.7 


Q(0) 


'6.5 


7.1 


Q(T) 


7.5 


8.5 


Q(V) 


7.6 


8.5 


Q(CEM) 


6.1 


6.2 


Q(CES) 


7.8 


8.6 


Q(CET) 


7.8 


8.6 


Q(CH) 


' 7.7 


8.3 


Q(CK) 


6.7 


7.5 


Q(CKH) 


7.8 


8.6 


Q(CP) 


6.1 


6.2 


Q(CS) 


7.8 . 


8.6 


Q(CT) 


6.1 


6.2 


Q(PF) 


7.8 


8.6 


Q(PKF) 


5.2 


5,2 


Q(PTF) 


7.7 


8.3 


Q(PG) 


6.5 


7.5- 


Q(PKG) 


5.2 


5.2 


Q(PTG) 


5.2 


5.2 


Q(CTM) 


7.0 


7.6 


1 


•• 5.1 


5.6\ 


A 


4.5 


•4.8 \ 


F ' 


4.5 


3.0 


L 


4.1 


5.1 


M 


7.3 


8.3 


D 


5.0 


5,8 


R 


6,1 


6.2 
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Interpretation of Results 

More students from the 1976 orientation class compleied 
courses than did students from the 1975 class, but the 1976 
group's grade point average was lower than that for the 
1975 cohort. The fact that more of the less able students 
were motivated to complete courses may be viewed as 
evidence of an impact of the use pf cognitive style infor- 
mation in the orientation. The results of an investigation 
into the amount of growth from September to December 
^ in the 1976 class were. confounded by the lack of data on 
the typical amount of growth experienced by the special 
needs students. For the Theoretical Symbols and Reading 
Level, 70 percent of the students retested in December did 
not appear to change in their relative abilities, 10 percent 
showed score declines, and 20 percent showed score 
increases. Since only a small, voluntary sample was avail- 
able for the retest and attitude data collection, generaliza- 
tions beybnd these subjects are not justified. 



Implementation in a Physical Education Setting 

De5cr/pf/on 

Using videotape? recordings, golf students were evaluated 
on a set of criteria for their golf swings. On the basis of 
these data, two groups were formed: successful and unsuc- 
cessful. Cognitive style maps for the students in these 
groups were used to generate nr^^jps characterizing success- 
ful and unsuccessful students. - 



1 ■■ t . 

TABLE 4;14. 

Growth in Theoretical Map Elements and Reading Level 
between September and December 1976 Testing 



Growth 

Map ~~ " 

Bement Decline No Change Increase 



TAL 


2 


8 


0 


TAQ 


0 


10 


0- 


TVL ^ 


3 


2 . 


5 


TVQ 


0 


7 


3 


^Reading Level 


^ 0 


8 


. 2 


Total 


5 


35 


10 




fva/uaf/on Methodology ^ 

The physical . education implementation afforded an 
opportunity to investigate techniques for developing maps 
that could be used to collectively describe or portray the 
cognitive style characteristics of a group. Three metliods 
for determining group maps were compared. Also, a 
stepwise regression procedure was used to generate a 
prediction equation on half of the students and to cross- 
validate on the other half. The overall intent was to try to 
identify procedures that would reliably differentiate cogni- 
tive style among groups of students. 



Results 

On the basis' of the frequency distribution of criterion 
scores from two sections of golf students, two groups at 
extreme ends of the golf swing ability scale were selected 
to form the successful and unsuccessful groups. Table 4.15 
displays the distribution of criterion scores and the scores 
of the students in tbe two groups. 
V 

Three rnethods of forming group maps were investigated. 
T^e first was the method u.«^ed most frequently in the work 
of Hill, his associates, and his students. According to this 
method of analyzing group cognitive style, if 70 percent of 
the members of the group indicated a decile ranking on a 
particular map element of 70 or higher, the element 
entered the group map at a "major" level. If 70 percent of 
"the group showed "a decile ranking on a particular map 
element of 30 or higher, the element became a member of 
the group map at the "minor" level. Each of the 32 
^ elements of the map was considered one at a time, and ils 
membership in the collective map for the group was deter- 
mined. Table 4.16 shows the maps which describe success- 
ful and unsuccessful groups of student jdetermined by this 
method. 

The second method for determining group maps was: the 
averages method. According to this method, the group 
average decile ranking for each of the 32 map com- 
ponents was u$ed to determine the major or minor status 
of the elements in the group's collective map. Table 4.17 
displays the maps formed for the successful and unsuc- 
cessful groups using the averages" method. 

The third method for determining group maps employee! 
an analysis of -variance procedure. The decile rankings for 
the element^ of each of the four map areas— Theoretical 
Symbols, Qualitative Codes, Cultural Determinants, and 
Modalities of Inference— were subjected to an ANOVA 
procedure to determine which elements reliably differ- 
entiated groups. Only the Qualitative Codes area pro- 
vided an F-ratio that was significant at the .0001 level. A 
Bcnferonni follow-up was used to identify the elements 
that contributed to the group differences for the 21 quali- 
tative code symbols. 
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Since.the 21 qualitative codes are generated from the seven a 
competency scales, an ANOVA procedure comparing the 
competency scale deciles for the two groups was con- 
sidered. This procedure provided an F-ratio that was not 
significant, indicating that the difference for the two 
groups lay in the translation of the competency scale 
results into the qualitative codes and not in their perfor- 
mance on the competency scales. A summary of the 
analysis of variance result^is shown in Table 4.18. Table 4.19 
contains the results from the Bonferonni follow-up proce- 
dures that were used to identify the qualitative codes con- 
tributing to the significant F-ratior';, 



TABLE 4!l5 

Identification of Criterion Scores of Subjects 
in Successful and Unsuccessful Croups 



Section 


Score ' 






5100 


88 






5100 


88 






5100 


. 110 




Unsuccessful 


5100 


114 






5100 


115 




h 


5100, 


130 




3— 


5101 


130 


0 




5100 


134 




.i 


5100 


. 134 




5101 


135 






5100 


137 ^ 






5100 


138 






5100 


140 






5100 


143 






5101 


150 






5101 


153 






5100 


154 






:ioo 


157 






5(00 


160 






5100 


165 






SI 01 


165 






5100 


165 






5100 


180 






5101 


190 






5100 


.195 






5101 


195 






5100 


195 




Successful 


5101 


196 






5101 


210 
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A comparison of the collective maps determined by the 
three methods described above Is shown in Table 4.20. 
Only the 70-percent-of-the-group method was successful 
in identifying any map elements that would oe unique to 
the maps of the successful or unsuccessful groups. 



A stepwise regression was used to determine the predicta- 
bility of the criterion score by the cognitive style elements. 
This regression procedure u^sed raw scores on the 16 tests 
and subscales of the Educational Cognitive Style Test and 
Inventory as predictors of the criterion score. Seventeen of 
the 31 students were systematically chosen to represent the 
range lof criterion scores. The regression equation shown 
below accounted for 90 percent of the variance. 

y = -6.26 + 5.74 (Listening Comprehension) + 2.94 (Science) 
= -2.13 (Arts) + 4.98 (Business Contact) - 5.91 (Associates) 



Raw scores for the remaining 14 students were then used in 
the regression equation to predict criterion scores. The 
Spearman's Rho correlatfon index for. the predicted and 
actual ranking on tho criterion score was 0.3. 



Since the averages and ANOVA methods were unsuccess- 
ful in, determining unique map elements, and the cross- 
validation of the regression equation yielded unsatis- 
factory predictability, an investigation -was initiated to 
examine the characteristics of the profiles on the cognitive 
style elements of the students in the successful and unsuc- 
cessful groups. Sample-profiles are sh^own in Figures 4.1 
and 4.2 for the map areas Theoretical Symbols and Cultural 
Determinants. By examining these profiles, it is possible to 
visualize much within-group variance on the map 
elements. This large within-group variance contributes to 
the inability to reliably differentiate among groups with 
respect to style. 



Interpretation of Results 

The commonly used and accepted statistical decision rules 
were unable to reliably differential? between the-success- 
ful and unsuccessful groups on the basis of these educa- 
tional cognitive style^ data. The 70-percent-of-the-group 
rule was the only one that was able to identify unique 
elements and differentiate the-groups. The extent to which 
these groups are in fact psychologically or edgcationally 
different from one another — as educational cognitive style 
specialists suspect they are — is a matter deserving further 
investigation. 



' TABLE 4.16 

Unsuccessful and Successful Collective Maps 
Determined by the 70-Percent-of-the-Group Method 



Unsuccessful Map 














TAL' 


QiTl- 


Q(PF) 


1' 


L' 




TE 


TAQ' 


Q(V) 


Q(PTF) 


A' .. 


M 




SC 


TVL' 


Q(CES) 


Q(RG) 


■'F' 


D' 




ARTS' 


TVQ' 


Q(CET) 


Q(CTM) 








BD' 




Q(CH) 








■ 1 


MECHR' 


Successful Map 










/ 




TAL' 


Q(A) 


Q(CKH) 


Q(PKF)' 


r 


M 


TR' 


TAQ' 


Q(0)' 


Q(CP) 


Q(PKF)' 


A' 


L' 


TE' 


TVL' 


Q(T) 


Q(CS) 


Q(PTG)' 


F' 


P' 


ARTS' 


TVQ' 


Q(V) 


• Q(CT) 






R 


EC 




Q(CEM)- 


Q(PF) 








. < BD' 




Q(CES) 


Q(PTF) 








fMECH R' 




Q(CET) 


Q(PG) 












Q(CH) 


Q(CTM) 












Q(CK) 
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TABLE 4.17 



Unsuccessful and Successful Collective Maps 
Determined by the Averages Method 



Successful 



TAL' 


Q(A) 


Q(CT) 


1 I' 


L' 


TR' 


TAQ' 


Q(o): 


Q(PF) 


A' 


M 


TE 


TVL' 


Q(T) 


Q(PTF) 


F' 


D' 


SC 


TVQ' , 


Q(V) 


Q(PG) 




R' 


ARTS' 




Q(CEM) 


Q(CTM) 






SS' 




Q(CES) 


Q(PFK)' • 






B'C 




'■. 'CET) 


Q(PKG)' 






BD' 




g,CH) 


Q(PTG)' 






MECH R' 


• 


Q(CK) 












Q(CKH) 












Q(CP) 












Q(CS) 










Unsuccessful 












TAL' 


Q(T) 


Q(A)' 


I' 


L' 


TR' 


TAQ' . 


Q(V) 


Q(0)' 


A' 


M' 


TE' 


TVL' 


Q(CES) 


Q(CEM)' 


F', 


D' 


SC 


TVQ' 


Q(CET) ■■ 


Q(CP)' 




R' 


AR" d' 




Q(CH) 


Q(CT)' 






• sr 




Q(CK) 


Q(PKF)' 










Q(CKH) . 


Q(PKG)' 










Q(PF) 


Q(PTG) 






/tECH R' 


0 


Q(PTF) 












Q.(PG) 












Q(CTM) 











TABLE 4.18 

Analysis of Varian^> ^esnP ^ 
Successful and Unsuccessful C *oups 



Map Component 


F Valt/ 2 


PR F 


Theoretical Symbols 


0.: J 


.6137 


Qualitative Codes 


17, i3 


,0001 


Affiliation 


r.M 


.8827 


Modalities of Inference 


A.62 


.4356 


Co^mpetency Scales 


0.40 


.5313 



Bonferonni Follow>up 
Qualitative Codes 



I 11 




< 


0 

w 

0' 


5? 


p 

Of 


> 


I 

U 

0^ 


C; 


■■ u 


X 

u 
y 


g 

w 

0^ 


Z 

u 

y, 


U 

W' 

V 


u 

w 


c 

w 


Q 

L 

(/ 


■ ^ 
Ik 

Q. 

w 

w 


E 

w 

. C/ 


w 

u 


1 

(/ 


t 


c 

V 


Onsuccessful 
« 


X 
sd 


4.B 
26 


4.4 
29 


0 


7.4' 
11 


7.4 
11 

ii 1 


5.2 
39 


7.8 


7.8 
08 


7.2 
15 


7.2 
15 


7.8 
08 


5.2 
3.9 


7.B 
0.8 


5.2 
3.9 


7.8 
0.8 


5.0 
4.2 


7.2 
1.5' 


7.2 
1.5 


5.0 
4.2 


5.0 
4.2 


7.2 
1,5 


Successful, > 


I 
sd 


. 7.4 
1.5 


5.2, 
1.1 


0 


8.2 
0.4 


8.4 
0.5 


7.8 
1.3 

> 


8.6 
0.5 


8.6 

0.5, 


8.4 
0.9 


7,8 

ip 


8.6 
0.5 


7.8 
1.3 


8.6. 
0.5 


7.8 
1.3' 


8.4 
0.5 


6.2 
3.1 


8.4. 
0.5 


7.6 
1.1 


6,2 
3.1 


6.2 
3.1 


8,4 
0.8 




2.6 


0.8 


0 


0.8 


1.0 


2.6 


0,8 


0,8 


1.2 


0.6 


0.8 


2.6. 

V 


'0.8 


2.6 


0.6 


12 


1.2 


0.4. 


1.2 


1.2 


1.2 


lvalue^; 


1.73 


0.27 




0.68 


1.71 


1,26 


1,69 


1.69 


1.37 


,,.60 


1.69 


1.26 


1.69 


1.26 


1.27 


.46 


1.52 


.43 


.46 


.46 


.46 



1 A t' 

'Using a Bonferonni technique lo control the experiment-wise type I error rate at |hfe^.05 level; .05jyy 8 ? 4.50. k 
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TABLE 4.20 

Comparison of Results , ' ' 

from 70%-oi-the-Croup, Averages, and ANOVA Techniques . 

Collective Map Formation 



40 



* 


Number of Qements in 
Collective Map 


jS : 

Number of Unique Elements in 
Collective Map 


Technique - 

— 1 


Successful Unsuccessful 


Successful Unsuccessful 


1.70%ofthegr(^0p . 

2. Average^. ^< 

3. an6va.{ 


31 19 

31 31 • 

32 32 


' " 12^ 0 
0 0 
•0 p 


. — w- 

Note: Maximum number of map elements = 32. • 



■ o ^Six o( the map elements present at the "major" level in the Successful collective map were identified as members of the Unsuccessful 

ERJ C collective map at the "minor" level. 



Theoretical Symbols 



Unsuccessful 



Successful 




TAQ 



TVQ 



Group Averages 



10 



Unsuccessful 



i 



■^1 

Successful 



TAL 



TAQ 



TVL 



TVQ 



Figure 4.1. Map Profiles, Physical Education— MCCC. 
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33 



42 



Unsuccessful 



Cultural Determinants 



Successful 




10 



^ 5 




Group Averages 



10 



Unsuccessful 



^ 5 ' 



Successful 
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Figure 4.2. Map Profiles, Physical Education— MCCC. 



Research in an Educational Psychology Setting 

pescnption 

>Six interpersonal skills laboratory classes participated in this 
implementation. For each of the classes, match scores 
between each student and the lab instructor were cal- 
culated on the tests and subscales of the Educational 
Cognitive Style] Test and Inventory. Information derived 
from the cognitive style battery did not influence instruc- 
tion in the classes; neither teachers nor students had their 
maps interpreted until the end of the semester. 



Evaluation Methodology 

The participants from the MSU School of Teacher Educa- 
tion provided six classes for investigating the relationship 
between the degree of student/teacher match on cogni- 
tive style elements andcourse outcomes. A behavioral out- 
come measure and a series of attitudinal measures were 
considered. 



Results ' 



The teacher determined a student's final score on the 
course behavioral observation checklist by rating the 
student at dhree levels of mastery on a series of inter- 
personal skills. The three subscale scores were determined 
from the end-of-course administration of an attitude 
instrument designed specifically for the MSU educational 
psychology course. The students were instructed to rate 
each of 23 statements on a continuum from one through 
five ranging from strongly agree to strongly disagree. The 
items identified as measures of each of the three subscales 
are listed in Table 4.21; scale reliabilities are also given. 



Table 4.22 summarizes the results of the stepwise regres- 
sion procedures used to predict each of the four criteria 
using th'i 32 predictor variables (16 '•aw scores and 16 match 
scores). The criterion for the inclusion of variables was set 
at 0£ = .10 for each regression equation. The regression 
equation for the group participation subscale score cri- 
terion accounted for 37 percent of the variance. The two 
criteria most directly related to teacher and student inter- 
action — the behavioral observation checklist determined 
by the teacher and the students' evaluation of the 
TA — yielded regression equations that accounted for 11 
and 29 percent of the variance, respectively. 



For each of the six classes, raw scores'on the 16 tests and 
subtests of the Educational Cognitive Style Test and Inven- 
tory were used to calculate 16 match scores between 
teacher a.nd student according to the Hill procedure: 



1-1 XR.-XSjjl 



where: 

XMj| = match score on testj for student j 
XR^ = referent (teacher) score on testj 
XSjj = student j score on testj 
tj = maximum score on testj 

The students' match scores were then concatenated with 
their raw scores on the 16 tests and subscales of the Educa- 
tional Cognitive Style Test and Inventory. The scores were 
then used as predictor variables for four separate end-of- 
course criteria: 



1. Final score on the course behavioral observation check- 
list / 

2. Attitude Instrument Subscale 1: Teacher Evaluation 

3. Attitude Instrument Subscale 2: Learning Outcomes 

4. Attitude Instrument Subscale 3: Group Participation 



Since the major purpose of this implementation yvas to 
determine the relationship between student/instructor 
cognitive style match and course outcome measures, the 
four course outcome measures were used as criterion 
variables in stepwise regression procedures using only the 
16 match :cores as predictor variables. The results of these 
regression analyses are shown in Table 4.23.. The criterion 
for variable inclusion wa% again set at a = .10. 



The correlations between the criterion measures and the 
32 predictor variables v/ere examined in order to investi- 
gate further the lack of success in obtaining regression 
equations that account for a satisfactory amount of 
variance. Tables 4.24, 4.25, 4.26, and 4.27 present corre- 
lations of the predictor variables with the behavioral 
observation, evaluation of TA, learning outcomes, and 
•igroup participation criteria. The magnitudes of the corre- 
lations suggest that there is very little relationship between 
the predictor variables and the criterion. This is especially 
true for the correlations between match score and 
criterion. 



Interpretation of Results 

No relationship was found between the match— as defined 
in the St. dy— of student and teacher style and any of the 
four criteria used in the study. 
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TABLE 4.21 

Subscales from Educational Psychology Attitude Instrument 



Subscale 1: Evaluation of TA (reliability = .81) 
Items 

7. I feel that my TA cares about me as a person. / 
9. My TA does not confront me in the IPL group. 

J 13. My TA is usually on time for the IPL session. . " ^ 

17. I feel very threatened by my TA. 

19. My TA usually gives me responsible feedback. 

20. In general, I am very satisfied with my IPL group leader. 

21. My TA adequately integrates the Ed 200 content (textbook material) with IPL. 

Subscale 2: Learning Outcomes (reliability - .67) 

**. . 

Items 

. 2. I arn satisfied with my own progress in mastering the IPL skills. 
11. My TA presents the Ed 200 "subject matter" in a way I understand. 

18. I feel that my TA's confrontation of me is facilitating my growth. 
23. I am satisfied with my own level of mastery of the IPL skills. 

Subscale 3: Group Participation (reliability ~ .89) 

Items 

3. My group leader usually helps me feel comfortab^e in the grogp. 
-4. My TA is helping me feel like sharing myself honestly with this group. 
5. I feel that I belong in this group. 

8. My TA is helping me feel that 1 belong in this group. 
10. I feel comfortable participating in my group. 

15. I know the names of most of the people in my IPL. 

16. I usually feel like talking in my group. 

22. Most (or all) group members help me to feel good about what is happening in the group. 

' : 

\ ■ ■ . 

\ 



Implementation in a Graduate Education Course 

■ Description 

Two approaches to instruction — Individual/Independent 
and Peer/Discussion — were designed and implemented 



for two units in a graduate education course. Referent 
maps identifying the key map components for the 
approach were formed for each* group. This was 
accomplished by project staff and the instructor, who 
evaluated the material and methods to be used in the two 
approaches and determined the key map elements and 
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TABLE 4.22 

Results of Stepwise Regression Procedures 
to Predict Behavioral Observation'and Attitude Measures 
. Using the 16 Raw Scores Concatenated with 16 Match Scores as Predictor Variables 



Criterion 


R2 


Predictor Equation 


Behavioral Observation 


.11 


49.11 - 38 (Social Service) + 34.16 (Match Social Science) 


Evaluating TA 


.28 


19.22 + 0.29 (TVL) - 0.20 (TAL) - 0.49 (Science) + 15.64 (Matcli Science) - 9.75 (Match Arts) 


Learning Outcomes 


.07 


10.84 - .167 (Business Contact) 


Group Participation 


.37 


30.40 + 0.40 (TVQ) - 0.31 (Mechanical Reasoning) - 0.56 (TAL) - 2.56 (Social Service) 
+ 0.13 (Reading Rate) + 14.42 (Match Mechanical Reasoning) - 10.88 (Match Businesi 
Detail) : 






TABLE 4.23 • 




Results of Stepwise Regression Procedures 
to Predict Behavioral Observation and Attitude Measures 
Using 16 Match Scores as Predictor Variables 


Criterion 


R2 


Regression Equation 


Behavioral Observation 


.08 


32.80 + 24.12 (Social Service) + 23.79 (Trades) 


Evaluation of TA. 


.06 


24.266 - 6.488 (Listening Comprehension) - 5.744 (Arts) 


Learning Outcomes 


.13 


14.404 + 3.654 (Mechanical Reasoning) - 8.688 (Trades) - 7.423 (Business Detail) 


Group Participation 


•17 


21.310 + 18.285 (Language Usage) + 9.015 (Mechanical Reasoning) - 22.479 (Listening 
Comprehension) - 12.900 (Business Detail) 



their minimum decile value, for optimum learning. A set of 
map elements was determined for each approach ; students 
in the class were divided into two groups by comparing 
each student's cognitive style map with the referent map of 
each approach. 

£va/ua(/on Methodology 

Class members were. sorted into two groups so as to 
maximize students' chances of learning the course 



material. Assessment of the reliability of this sorting 
process was part of the evaluation. In addition, -two 
outcome measures — scores on a written theme and scores 
on a multiple-choice test— were used to compare the 
performance of the two groups. 

Results 

1. Learning Outcomes. The primary objective of the 
implementation plan was to sort the graduate education 
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TABLE 4.24 

t Coirelations between Predictor Variables and the Behavioral Observation Criterion 





Raw Score 


Match Score 




Correlation 


Correlation 




with Criterion 


with Criterion 


Language Usage 


1 AC 


.051 


Numerical Computation 


.185 


.128 


Mathematics Usage 


.119 


.038 


Mechanical Reasoning 


.150 o 


.065 


Listening Comprehension 


1 T1 

.Izl 


.043 


. Trades 


.035 


.240 


Technical 


.022 


.198 


Science 


.053 


•088 


Arits ■ 


-.045 


.050 


Social Service 


-.073 


.287 


Business Contact 


.009 


.206 


Business Detail 


.113 


.150 


Individual 


.074 


-.069 


Associates 


-.038 


.140 


Family 


-.009 


-.153 


Reading Rate/ 






Comprehension 


.095 


.023 



TAB-E 4.25 

Correlations between Predictor Variables and the Evaluation of TA Criterion 







Raw Score 
Correlation 
with Criterion 


Match Score 
Correlation 
with Criterion 


Language Usage 




.193 


.073 


Numerical Computation 




.055 


.083 


Mathematics Usage 




.135 


-7,061 


Mechanical Reasoning 




-.089 


.017 


Listening Comprehension.— . 




-.174 - 


-.144 


Trades 




-.114 


-.076 


Technical 




-.086 


-.012 


Science 




-.209 


-.007 


Arts 




-.105 


-.187 


Social Service 




-.045 


-.053 


Business Contact 




-.220 


.011 


Business Detail 




-.104 


-.121 


Individual 




-.051 


.007 ' 


Associates 




.044 


.114 


Family 




-.054 


-.045 


Reading Rate/ 








, Comprehension 




.093 


.031 
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TABLE 4.26 

Correlations between Predictor Variables and the Learning Outcomes Criterion 





l%fllW dl.UiC 


Match Score 






Correlation 




Willi V«lilt=flUII 


with Criterion 


Language Usage 


.046 


... 

-.021 


Numerical Computation 


.000 


.006 


Mathematics Usage 


.050 


-.093 


Mechanical Reasoning 


-.055 


.117 


Listening Comprehension 


-.121 


-.102 


Trades 


-.213 


-.194 


Technical 


-.126 . 


-.133 


Science 


-.092 


-.063 


Arts 


-.056 


-.144 


Social Service 


f -.149 


-.132 


Business Contact 


-.274 


-.163 


Business Detail 


-.159 


-.244 


Individual 


-.148 


-.045 


Associates 


.067 


.123 


Family 


.044 


-045 , . 


Reading Rate/ 






Comprehension 


.133 


.025 



TABLE 4.27 

- Correlations between Predictor Variables and the Group Participation Criterion 



Raw Score Match Score 

Correlation Correlation 
with Criterion with Criterion 



Language'*Usage 


.205 


.108 


.Numerical Computation 


.178 


.122 


Mathematics Usage 


.239 


-.041 


Mechanical Reasoning . 


-.035 ' 


.147 


Listening Comprehension 


-.237 


-.209 


Trades 


-.194 - 


-.162 


Technical 


-.148 


-.149 


Science 


-.181 


-.061 


Arts - 


-.072 


-.137 


SocialService 


-.264 


-.193 


Business Contact 


-.238 


-.174 


Business Detail 


-.176 


-.193 


Individual 


-.189 


• -.098 


Associates . 


.146 


.029 


Family ^ 


.004 


-.003 


Reading Rate/ 






Comprehension 


.134 


.017 
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class students into two groups on the basis of the 
comparison of students' cognitive style -maps with 
two referent maps. The referent maps, labeled the 
. Individual/Independent appiroach and Peer/Discussion 
approach maps, are shown In Table 4.28. The eight students 
whose cognitive style maps matched the Individual/Inde- 
pendent referent map received that Individualized instruc- 
tion. The remaining nine students, whose cognitive style 
maps matched the Peer/Discussion referent map, were 
presented material through group discussion. 

Two outcome measures — a term paper and a test — were 
used In the course. Results for these outcome measures are 
presented in Table 4.29. Students in the Peer/Dlscusslon - 
group performed significantly better on the test than did • 
students In the Individual/Independent group. 

2. ReliabiHty of Sorting. Profiles of the students In the two 
groups were plotted so that ^n evaluation could be made 



\ • 

\ ■ 
\ 

\ 

\ 

of the degree of success achieved in using cognitive maps 
with referent maps to sort students into the two groups. 
Figure 4.3 shows sample profiles for thV Theoretical 
Symbols map ar-^as". Three separate graphs a redisplayed: 
Individual/Independent, Peer/Discussion, a nek Group 
Averages. Relevant referent points are indlcated\3n the 
group averages graph. Examination of these plots makes it 
possible to determine visually If the two groups diffeK in 
their map.structures and also to checl< the degree of match 
between the referent group map and the average map. 
profiles of the two groups. This was done for all of the 
elements, although only a sample of these plots is 
presented. 



An analysis of variance procedure was used to identify map 
elements that were different for the two groups. A 
summary, of the results Is presented in Table 4.30. None of 
the F-ratios reported was significant at the .05 level: 



TABLE 4.28 

Referent Maps for Individual/Independent and Peer/Discussion Croups 





Percentile 




Percentile 




Percentile 


Element 


Required 


Element 


Required 


, Element 


Required 


Individual/Independent 










12-FR 












T(VL) 


70-79 ' 


1 


70-79 


R 


70-79 


. Q(CS) 


70-79 


A' 


50-59 


L 


70-79 


Q(CET) 


80-89 






M' 


60-69 


Q(CTM) 


70-79 






D' 


50-59 


Q(CH) 


60-69 










Q(CEM) 


40-49 










Peer/Discussion 












FR . 












T(AL) 


80-89 


1 


70-79 


L 


70-79 


T(VL) 


50-59 


A 


70-79 


M 


70-79 


Q(CET) 


70-79 


F 


40-49 


R 


60-69 


Q(CEM) 


60-69 






D 


50-59 


Q(CH) 


70-79 










Q(CS) 


50-59 










Q(CTM) 


70-79 










Q(CT) 


70-79 
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TABLE 4.29 

Outcome Measures for 
Individual/Independent and Peer/Discussion Groups 



Individual/ Peer/ 
Independent Discussion t value 



pa pel- 


■ n V 

X 

sd 


-8 

3.56 
0.30 


9 

3.44 
0.39 


0.02 :: 


test 


sd 


3.31 
0.46 


3.81 
0.26 


2.50 



.05^4=''-76 



TABLE 4.30 

Analysis of Variance Results for 
Map Components of Individual/Independent 
and Peer/Discussion Groups 



Map Component 


F Value 


PRF 


Theoretical Symbols 


0.91 


.3429 


Qualitative Codes 


0.10 


.7491 


CoJtural Determinants 


0.02 


.8868 


Mociallties of Inference 


0.37 


.5468 


Competency Scales 


0.80 


.3729 



Interpretatiorvof Results 

The results suggest there was little success in separating the . 
students into two^distinct groups corresponding to the 
. referent maps. Thi^ is evidenced by the differences 
between group profiles and referent profiles, and also by 
the large within-group variance^in style. It is impossible to 
determine at this time w^hether another set of referent 
maps would allow, for more success in group sorting. The 
task is quite complex, since there are many map elements 
to consider simultaneously in sorting the students into 
groups having similar profiles. \ 

\' ■ 

Inability to differentiate between groups on the basis of 
style was also seen in the physical education setting; 
inability to reliably match a desired pr optimal style was 
seen in the humanities setting. These seern to be consistent 
outcomes. \ 

\ 

\ 

o \ 
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Summary of Teacher Debriefing Interviews 

Results of postimplementation debriefing interviews cbn- 
ducted with each participating teacher, are summarized 
below. The introductory statements and the questions are 
presented verbatim and are followed by general responses. 
The intervievvs were structured; each participant re- 
sponded to the same questions. 



Project Training. Now that you have participated in this 
initial implementation of educational cognitive style, we 
would like you to look retrospectively at the training phase 
of the project. 

Q. Did the training process provide you with the skills and 
knowledge regarding cognitive style that you needed 
to implement the procedures properly? Please explain. 

A. Without exception, the "participants felt they wiere 
trained well enough to effectively implement the 
cognitive style mapping procedures. 

Q. What were the most notable positive aspects, of 
training? 

A. Most positive aspects of training varied from partic- 
ipant to participant; they included the empirical 
mapping and simulation exercises, the developrnent of 
implementation plans, and the commitment to train- 
ing of pec staff and project staff. 

Q. What revisions or improvements in the training pro- 
cess would you suggest? 

A. Participants agreed that training was -toe fragmented 
— a more intensive, extended training workshop 
would have been more helpful. In additlbn, more map 
interpretation training sessions were desired. 



Implementation. Of course, one important aspect of the 
project is the wide variety of settings in which cognitive 
style is being implemented. It is very important therefore 
that we obtain rather complete descriptions of the actual 
implementation procedures in each setting. 

Q. Would you please describe in some detail the manner 
in which you used cognitive style information in your 
instruction? How did this differ from the plan you 
outlined over the summer? 

A. With the exception of the MSU counseling center, all 
were able to carry out implementations generally as 
planned, though there were changes within some 
settings. 

Q. How did the instructional procedures resulting from 
this implementation differ from your normal pro- 
cedures or procedures you ussd in previous terms. 




Theoretical Symbols 



Individual/Independent Peer/Discussion 




Group Averages 



10 Individual 




TAL TAQ TVL TVQ 



Figure 4.3. Map Profiles, Graduate Curriculum— MSU. j 
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A. In most cases, the majc v<ipact of cogr trve style 
mapping was greater prer'.ion in the kind' of instruc- 
tional treatment^ assigne d to students. 

Q. If you were to plan \^io(Ser impleme/ iiation in this 
same setting, what v/ xild you changef Why? 

A. Participants gener\uy egreed.that th^y would spend 
more time with ' »5p interpretation. 

Q. Have you cc.Vinued to use \ he cognitive style 
mapping pre . jdui><^s this term? '/Vhy or why not? 

A. Of the sevx-;::! participants, tw had continued into 
another sp /tester and a third planned to continue. Cir- 
cumstan r s prevented others uom doing* so. 

Q. In r^ .'Ospect, did you hav. the same confidence in 
you instructional procedures this term as you have 
ha^!m previous terms? V7hy'or why not? 

A. X,e. participants genei-dlly felt greater confidence 
?<*cause they believed '.hey knew student needs better 
and understood how / istructional treatment would be 
related to those nee^ s. 



Aoecdotai Information It is important in debriefing an 
experience such as th^^ to make a nicord of special events, 
situations, or occurre nces that seem noteworthy because 
they 'ead to some gt neralizatlon or conclusion about the 
experience. We wruld like lo note any such anecdotal 
instances in your ir.plementation of educational cognitive 
style. 

Q. Do any sue'/ events stand out in your mind? 

A. Three parricipants mentioned that students seemed to 
sense an agreement between the maps and their own 
view of rhemselves. 

» 

Q. As yju^ think about t^e^ relationship between your 
stur jnts and the instruction they received, were there 
arv instances where you saw a particularly effective 
m jtch between style and instruction or a very obvious 
n ismatch? Why d'j you-think this occurred and what 
resulted? 

A. iTrong\ Associates people seemed to work well 
togetheV. In fact, obvious matches or- mismatches 
reported ir\ all cases involved the Cultural Deter- 
minants style dimension. 

0 

Q. Were there any special problems that arose? How 
were they handled? 

A. The principal problem rhat arose was a shortage of 
time to devote to the project. 



Reaction to Measurement Procedures. Another phase of 
the project that we would like your opinion about is 'the, 
Cognitive Style Test and Inventory Booklet. 

Q. At any time during the project, did you review the 
various instruments in , the battery to see if they 
seemed to reflect cognitive style elements as you 
understand thfem? If so, what were your conclusions? 

A. Four participating teachers labeled the juditory math 
test very anxiety producing; four' cited the lack of 
apparent correspondence between the competency 
scales and qualitative map elements. 

•-f , 
Q. Wodid you judge the battery to be an effective or 
ineffective measure of style? Why? 

A. The participants thought that although the instrument 
seemed to lack some face validity, it was an effective 
measure of cognitive style. 



Impuct of Style on Students. We would also like your 
opinion about the impact of the implementation on your 
students, though we realize the impact data are yet to be 
'^analyzed and that you will be speculating. 

Q. Briefly and in very general terms, what do you think 
was the impact of ^he project on students whose 
cognitive styles were mapped and whose instruction 
was influenced by that map? 

A. Students tend to gain self-awareness— riot just in areas 
of weakness, but in positive as well as value neutral 
areas. 

Q. Were there any outcomes that you achieved that you 
had not been able to achieve previously— learning or 
attitude outcomes? 

A. There was a general increase in individualization. . 

Q. Was there an impact on communication or any other 
aspect of the interpersonal atmosphere? 

A. There was no generalized impact on interpersonal 
environment. 

Q. How familiar did your students become with the actual 
construct of educational cognitive style and the 
vocabulary associated with its measurement? If they 
were instructed, did they understand the nature of the 
construct? How do yOu know? 

A. There were no in-depth attempts to train students on 
style. Students generally understood the style con- 
cepts whenever they came into contact with them. 



Level of Commitment: TKe next area we wpuld lifce to 
explore is your attitude toward or commitment educa- 
tional cognitive style mapping as an instructional pro- 
cedure. 

Q. In retrospect, when you began training, what W2s your 
commitment? 

• A. Three participants were totally coi^irhitted from the 
start of the project. The other participants wef^ willing 
researchers who reported being committed to indi- 
vidualization. 

Q. After traininfj and before implemi;ntati6n, how would 
you characterize yo^r commitment? \ 

A. After trainir^g, all but one participant reported being 
committed to the concept. 

Q. How would you characi'jrize your current attitude or 
commitment? 

A. All but one reported be;ng highly committed at the 
time of the interview. ^ 

Q. Would you encourage your colleagues to learn about 
and use cognitive styie mapping procedures in tHeIr 
Instruction? Why? 

A. All but one reported they would encourage colleagues 
to learn about and use cognitive style. 



Impact on Teaching Practice. Finally, we would like to 
explore with you in some detail the impact of the project 
on some spectfir aspects of your instruction. 

Q. Do you feel that you know your own cognitive style in 
most contexts? 

a1 All participants reported that they knew their own 
cognitive styles. 

Q. Please state briefly how you think your knowledge of 
your own and your students' cognitive styles impacted 
each of the following: (If you do not understand any of 
these, I will explain them.) 

1. your course preparation / 

2. your instructional methojis 

3. your ability to diagnose student strengths and 
weaknesses ^ ^ 

4. your Instructional efficiency 

5. your feelings of success 

6. your enjoyment of teaching 

7. your acceptance of students 

8. your understanding of students 

9. your expectations of students 

A. In all but one setting, participants reported that knowl- 
edge of their own and their students' styles impacted 
various aspects of Instructional practice. 



Summary o^ Studer:f Attitude Survey 



St'jdents in several of the implementation studies were 
asked to complete the Student Attitude Sui-vey so that 
project staff could assess the impact of cognitive style map- 
ping on the attitudes of the student participants. Only stu- 
dents who received interpretations of their maps took the 
survey. Table 4.31 indicates the contexts in which survey 
data were obtained. . . ' 

Tfie student responses are those 'of individuals with rela- 
tively limited exposure to cognitive style mapping and its 
potential for^ improving educational programs and pro- 
cesses. Although tbe students vyho received map interpre- 
tations no doubt grasped rpuch of the meaning of the cog- 
nitive style map as it related to them, the short-term nature 
of their exposure preciudet? a complete understanding.of 
the full impact of the concept. The foJIowing data might be 
substantially different vyere the students involved on a con- 
tinuing basis in an educajid/ial environment where cogr\l- 
tive style mapping was an integral part of the educational 
process. 

The results of} the survey are presented in Table 4.32. 
Responses are J-eported as percents and are broken down 
for each of the implementation settings in which the Stu- 
dent Attitude Survey was administered. The results ' ^r each 
item were analyzed to determine whether the response 
pattern for the'group of students as a whole differed from a 
rdndom pattern. All response patterns except that for item 
4b proved to be other than random. . ^ 



TABLE 4.31 
Sources of Student Attitude Data 



Institution 



Number of Students 



Michigan State University 17 

Graduate Curriculum Course 17 

Macomb County Community College 108 

Science 21 

Humanities 79 

Special Needs 8 



TOTAL 



125 



125 
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Two sets of conditionals were analyzed for each of the per- 
sonal reaction questions. T le first conditional concerned 
..Individual map interpretation; the second concerned time 
during the semester when the map was interpreted. The 
response patterj s were subjected to a X^test to ascertain if 
either variable influenced students' responses to the 
personal reaction items. 



Results 

1. Verification of the Administration and Interpretation. 
■ Eighty-two percent of the 125 students Indicated that they 

had gained knowledge of their educational cognitive style 
during the project. Fifty-six percent of the students indi- 
cated that their cognitive style maps had been individuilly 
interpreted. This latter figure is defliiied by the students in 
the humanities clashes; only 37 percent of these students 
reported individual interpretations. In each of the other 
classes; over 75 percent of the students indicated that their 
maps had been individually interpreted. Ninety-four per- 
c'^nt of th^ students received information about their cog- 
nitive style within the first three weeks of the semester. 

2. Va//daf/on of the Information Provided in the Cognitive 
5«y/e Map. In evfer'y setting except one, less than half the 
students responded that they felt the map and its interpre- 
tation provided an accurate picture of themselves. Nearly 
as many students answered they were undecided. Fifty- 
four j^^jrcent of those students reporting individual inter- 
-pretation felt the map and its interpretation provided an 
accurate appraisal of themselves. Of the 55 students 
inclicating they did not receive individual map inter- 
pretation, 34 percent viewed the map and its inter- 
pretation as valid. Acceptance of the interpretation of the 
cognitive style map as accurate does appear to be affected 
by the mode of map interpretation. Forty-three percent of 
the-students reporting early feedback indicated that they 
felt the map and its interpretation presented an accurate 
picture of themselves. Of the eight students not reporting 
early feedback, 57 percent accepted the Interpretation of 
the map as valid. In :*nis case, early feedback did not appear 
to faplitate acceptance of the map interpretation. 

Approximately half the students (51 percent) Indicated that 
the map provided new information about themselves. Of 
those students reporting individual interpretations,.64 per- 
cent responded that the map information was new. Of the 
remaining students who did not report Individual inter- 
pretations, 35 considered the information provided by the 
rnap to be new. Th|js, it appears that the degree of new 
information gained by the map is ^ function, in part, of the 
mode of map interpretatiori. Comparison of the percent of 
students reporting early feedback with the percent not 
reporting'early feedback shows that receiving map inter- 
pretation within the first three weeks does not appear to 
increasfe the num(jer of students who. perceive the map 
Interpretations to be new information about themselves. 
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A large majority of the students (88 percent) felt that their 
cognitive styles were understood by their instructors. Indi- 
vidual interpretations and early feedback both appear to 
have a positive effect, which is d3monstrated in the num- 
ber of students reporting tliis opinion who i.ad citherJndi- 
vidual (96 percent vs 79 percent) or early (89 percent vs 67 
percent) interpretations. 



3. Using Cognitive Style Information for Making Educa- 
tional and Vocational Decisions, Less than half the students 
(42 percent) felt that the knowledge of their educational 
cognitive style would help them to make better decisions 
about their educational p[.ans. This and the other results 
reported in this section must be interpreted cautiously, 
however, because the students were given littio instruc- 
tion on style and no instruction on or information about 
how it might assist them in making educational or voca- 
tional decisions. When the students reportirig individual 
interpretations were considered, 46 percent replied that 
knowledge of their cognitive style would aid them in mak- 
ing better decisions about their educational plans. Thirty- 
six percent of the students not reporting individual inter- 
pretations felt that knowledge of their cognitive style 
would facilitate their educational planning. So it appears 
that, although individual interpretation does result in an 
increased number of students who view e'ducational cog-^ 
nitive style as an aid in making educational decisions, less 
than half the students expressed this opinion regardless of 
the mode of map interpretation. 

Of the students receiving early map interpretation, 44 per- 
cent felt that knowledge of their educational cognitive 
style would help them make better decisions about edu- 
cational plans. Of the group not reporting early i.iterpre- 
tation,* none felt that such knowledge would be helpful. 
This seems to Indicate that th^ timeliness of map interpre- 
tation has a marked effect ori attitude toward this topic. 

i 

There is a similar pattern in the responses to the question 
concerning the use of knowledge of. educational cognitive 
style for making better vocational decisions. One-third of 
the students responded that they felt knowledge of their / 
cognitive style would be useful'for this purpose. Very little 
difference is seen between the percent of students reply- 
ing "yes" to this question whether students were or were- 
not given Iridlvidual map interpretations (35 percent and 32 
percent, respectively), However, when the temporal fac- 
tor is addressed, a difference in respoi.:.e tendency is 
noted. Of those students receiving feedback on their map 
within the first three weeks of the semester, 34 percent 
replied that they felt knowledge of their educational cog- 
nitive style would be useful in making better vocational 
decisions. Of those students not reporting early feedback, 
only 14 percent responded affirmatively to this question. 

4. The Effect of Knowledge of Cognitive Style on Learning 
Outcomes. It is crucial to note here that there were no pre- 



TABLE 4.32 
Results oi Student Attitude Survey 



1. Did you jaIn knowledge of your educational cognitive style during this course? 



% yes 
% no 



Ail 

82 

1C 



MSU 

94 
6 



MCCC 

80 
21 



Science 

86 
14 



Humanities Special Needs 



76 
24 



100 
0 



2. Did you have your cognitive style map Individually interpreted by your instructor? 



% yes 
% no 



All 

56 
44 



MSU 

76 
24 



MCCC 

53 
47 



Science 

95 
5 



Humanities Special Needs 



37 
63 



100 
0 



3. Did you receive information about your cognitive style within the first 3 weeks of the semester? 



% yes 
Vo no 



All 

94 
6 



MSU 

100 
0 



MCCC 

93 



Science 

95 



Humanities Special Needs 



92 
8 



100 
0 



PersomI R{.:actions 

1. Do you believe that your educational cognitive style map and its interpretation presented an accurate picture of yourself? 

Humanities Special Needs 



' 'Xy yes 
% undecided 
% no 



All 

'45 

15 



MSU 

44 

37 
19 



MCCC 

45 
41 
14 



^lence 

48 
33 
19 



38 
47 
14 



100 
0 
0 



Conditionals 



% yes 

% undecided 
% no 



1 

individual 
interpret. 

Yes No 



54 


34 


32 


53 


13 


13 



6.7 



2 

1st 3 
weeks 

Yes No 



43 


57 


42 


29 


15 


14 



X' =3.4 



2. Did the map provide you with information about yourself that you did not have before? 



% yes 
% un,decided 
% no 



All 

51 
20 
30 



MSU 

47 
13 
40 



MCCC 

52 
21 
27 



Science 

52 
24 
24 



Humanities Special Needs 



48 
22 
30 



88 
0 

\12 



*v2 



X value is significant at OC = .05 level 
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Conditionals 



1 

individual 
interpret. 



2 

1st 3 
weeks, 



% yes 
% undecided 
% no 



Yes 


No 


64 


35 


12 


29 


24 


36 



= 11.1 



Yes No 



54 


71 


21 


0 


25 


29 



2.4 



Do you feel your instructor understood your educational cognitive style? 



% yes 
% no 



All, 



81 

ii: 



MSU 

88 
12 



MCCC 

88 
12 



Science 

95 
5 



Humanities Special Needs 



84 
16 



100 
0 



Conditionals 



vci yes 

% nc ' 



individual 
^Interpret. 

Yes No 



96 


79 


4 


21 



2 

1st 3 
weeks 

Yes No 



89 


67 


11 


33 



=7.3 



Do you believe that knowledge of your educational cognitive style will help you to make better decisi 
a) educational plans? 





All 


MSU 




% yes 


42 


29 




% undecided 


23 


29 




% no 


30 


41 








1 






individual. 


Conditionals 




Interpret. 






Yes 


No 




% yes 


46 


36- 


"/ 


undecided 


30 


24 


% no 


24 


40 


b) vocational plans? 








All 


MSU 


% yes 


33 


18 




% undecided 


30 


24 




% no 


36 


59 





value is significant at a= .05 level 



MCCC 

44 

28 
29 



= 3.8^. 



MCCC 

36 
32 
33 



Science 

40 
35 
25 

2 

1st 3 
weeks 

Yes No 



Humanities 

40 

27 
33 



44 


\o 


26 


67 


29 


33 \ 



=8.5 



isions about your: 
Special Needs 



88 
12 
0 



Special Needs 




(contmued^ 
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sTABLe'4.32 (continued) 



Conditionals 



% yes 

% undecided 
% no 



individual 
interpret. 

Yes No. 



35 


32 


33 


26 


32 


42 



1.3 



2 

Isl 3 
weeks 

Yes No 



34 


14 


31 


43 


35 


43 



X" = 0.3 



5. Is it your opinion that knowledge of your educational cognitive style in this course probably helped you to: 
a) learn course material faster than you usually Ho? 



Vn yes 
% undecided 
% no 



Conditionals 



All 

16 
34 
50 



% yes 
% undecided 
% no 



MSU 

12 
35 
53 

1 

individual 
interpret. 

Yes No 



16 


17 


31 


39 


52 


44 



17 
34 
49 



X' = 0.64 



Science 

0 
40 
60 

2 

1st 3 
weeks 

Yes No 



17 


14 


35 


29 


48 


57 



Humanities Special Needs 



18 
33 
49 



X' =0.6 



-57 
28 
14 



b) learn course material more thoroughly than you usually do? 



% yes 
% undecided 
% no 



Conditionals 



All 

25 
30 
45 



% yes 
% undecided 
% no 



MSU 

24 
35 
41 



1 

individual 
interpret. 

Yes No 



28 


23 


25 


34 


46 


43 



MCCC 

26 
29 

. 46 



Science 





22 


23 




38 


27 




40 


50 




2 




1st 3 




weeks 




Yes 


No 




27 


0 


= 4.2 


29 


50 


43 


50 



Humanities . , Special Needs 



71 
14 
14 
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c) enjoy the course more than you usually do? 



%yes 
% undecided 

% no • 



All 

36 
27 
37 



MSU 

41 
24 
35 



MCCC 

35 
27 
38 



Science 

37 
21 
42 



Humanities Special Needs 



32 
31 
37 



71 
14 
14 



Conditionals 



individual 
interpret. 



2 

1st 3 
weeks 



% yes 
% undecided 
% no 



Yes 


No 




Yes 


No 


41 


28 




39 


0 


18 


40 


=7.6 


27 


33 


41 


32 




34 


67 



2.7 



6. Did knowledge of your cognitive style and the styles of others increase your awareness of the divcsity of human beings? 



% yes 
% undecided 
% no 



All 

55 
20 
25 



MSU 

77 
0 
23 



MCCC 

51 
23 
26 



Science 

33 
43 
24 



Humanities Special Needs 



54 
18 
28 



75 
13 
12 



Conditionals 



1 

Individual 
interpret. 



2 

1st 3 
weeks 





Yes 


No 




Yes 


No 


% yes 


72 


54 




.65 


50 


undecided 


22 


19 


=8.7 


29 


33 


% no 


6 


27 




6 


17 



0.1 



7. Would you recommend that your friends take courses in which educational cognitive styles are mapped? 



% yes 
% undecided 
% no 



All 

63 
29 
8 



MSU 

88 
12 
0 



MCCC 

59 
32 
9 



Science 

, 57. 
29 
14 



Humanities Special Needs 



57 
34 
9 



100 
0 
0 



'Conditionals 



"A yes 
% undecided 
% no 



individual 
interpret. 

Yes No 



72 


51 


22 


38 


6 


11 



X' =5.1 



2 

1st 3 
weeks 

Yes \ No 



65 



29 



57 



\29 



X =0 



*v2 



X value is significant at 0^ = .05 level 
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TABLE 4.32 (continued) 



Do you believe that other instructors would benefit from using educational cognitive style maps in their courses? 



% yes 
% undecided 
% no 

' Conditionals 



All 

69 

8 



% yes 
% undecided 
% no 



MSU 

69 
25 

7 

1 

individual 
interpret. 

Yes No 



70 


. 65 


24 


23 


6 


12 



MCCC 

69 
23 
8 



1.7 



Science 

67 
29 

5 



2 . 
1st 3 
weeks 

Yes. No 



69 


71 


25 


0 


5 


29 



Humanities Special Needs 



66 
24 
10 



= 3.3 



100 
0 
0 



conceived expectations regarding the effect of style on stu- 
dent perception of learning outcomes. The questions 
asked were simply exploratory. 

Half the students responded that knowledge of their cog- 
nitive style maps did not help them learn the course mater- 
ial faster than usual. The results do not seem to be affected 
by the mode of map interpretation. Of those students 
reporting individual interpretations, 16 percent said "yes" 
to the question concerning learning course material faster. 
- Of those students not reporting individual interpretations, 
17 percent responded "yes" to this question. The timing of 
map interpretations did not appear to impact these results 
either. Of the 117 students reporting early feedback, 17 
percer^t responded "yes/' whereas 14 percent of those not 
reporting early feedback replied "yes." Therefore, regard- 
less of the mode of interpretation or time of feedback, less 
thvm 20 percent of the students felt that knowledge of edu- 
cational cognitive style helped them to learn the coursjp 
material faster. 

It should be noted, however, that over half (57 percent) 
the special needs students felt that knowledge of educa- 
tional cognitive style facilitated tht speed of acquisition of 
course material. The students In the science, humanities, 
and graduate curriculum classes did not, on the ayerage, 
view k.nowledge of educational cognitive style as an aid In 
learning the course material faster! 

When the issue of the impact of knowledge of style on 
learning course material Is addressed, results are sirrillar for 
the overall group and for those students who did or did not 
report receiving individual interpretations. In each case, 
the percent of students who responded "yes" was about 25 
percent. Of those students who reported receiving early 



map interpretation, 27 percent replied "yes." Of the stu- 
dents without early feedback, none thought that the thor- 
oughness of their learning of the course material was Influ- 
enced by knowledge of their cognitive style. Of the stu- 
dents In the special needs setting, 88 percent Indicated that 
knowledge of their cognitive style did Influence their 
learning, at least to some degree. This was not the case in / 
any of the science, humanities, or graduate curricuHum/^ 
settings. f j 

Thirty-six percent of the students, still less than hajf, 
responded that knowledge of their cognitive style prob- 
ably did enable them to enjoy the course more than they 
usually do. Of those students reporting individual inter- 
pretations, 41 percent indicated they enjoyed the course 
more because of their knowledge of their educational^cog- 
nitive style. Of those students not reporting Individual 
interpretations, only 28 percent responded "yes" to this 
question. Thus, whether or not the students receivea indi- 
vidualized map interpretations did Influence how they per- 
cel ^ed the effect of the knowledge of their cognitive style 
on ;he enjoyment of the course. A similar result Is fo'tjrui 
for tne Issue of the time of map interpretation feedback. Of 
the students receiving early map Interpretatlori, 39 percent 
-responded "yes," whereas zero percent of the students 
who received no early feedback replied "yes." Once again, 
a large majority (79 percent) of the students In the special 
needs setting reported that knowledge of their cognitive 
style aided In their enjoyment of the class. This, reaction 
was not found in the other classroom settings. 

5. Increasing the Awareness of the Diversity of Human 
Beings. Fifty-five percent of the students Indicated that 
knowledge of their own style Increased their awareness of 
the diversity of human bieings. This increase In awareness 
appears to be a function of the mode of interpretation, 
since 72 percent of those students receiving individual 



interpretation signified an increase in awareness while 54 
percent of those students not reporting individualized 
* interpretations indicated an increase. A potentially impor- 
tant though not statistically significant difference in the 
percent of those responding ''y^s" is also seen between 
those students who did and did not report early feedback 
(75 and 50 percent, respectively). The students in the grad- 
uate curriculum course and the special needs setting 
appeared to be more sensitive to the diversity of human 
beings, as indicated by 77 percent and 75 percent, respec- 
tively, responding "yes" to the item. 

6. Recommendat/ons for Future ^Use of Cognithe Style 
Maps. The students definitely recommended that other 
students take courses in Which cognitive styles are mapped 
(63 percent said "yes") and believed that cognitive style 
maps would be beneficial to other instructors (69 percent 
responiiei. favorably). Of those studc^nts reporting indi- 
vidualized map. interpretations, 72 percent recommended 
that their friends take courses in which educational cogni- 
tive styles are mapped. Of, those students not reporting 
individual interpretations, 51 percent recommended such 
classes to their friends. Although the percentage of stu- 
dents responding affirmatively varies somewhat depend- 
ing on tlie mode of interpretation, both interpretation 
groups tend to favor recommending courses employing 
cognitive style maps to their friends. Little practical differ- 
ence in the responses to this question is seen between the 
students reporting and not reporting early feedback; both 
groups reported a majority of "yes" respondents (65 and 57 
percent, respectively). The mode of interpretation and 
time of map feedback do not appear to be factors for see- 
ing cognitive style maps as beneficial to instructors of other 
courses. 



Summary of Survey Results 

The above results can be summarized as follows: 

1. Most students verified that they had gained knowledge 
of their cognitive style; most received individualized 
interpretations within the first three weeks of the 
semester. ' ' 

2. Less than half the students felt certain that the map and 
its interpretatioa provided an accurate picture of them- 
selves. A large proportion were not certain about their 
perceptions in this regard. -However, they were not edu- 
cated about style per se and may therefore have had dif- 
ficulty judging the accuracy of ii.*^ data. In a related 
area, the students were evenly divided with regard to 
the extent to which they thought the map provided new 
information about themselves. 

3. Most students either felt that knowledge of their cogni- 
tive style did not influence their academic performance 



or enjoyment of the class, or they were undecided as to 
Its influence. 

4. The majority of students reported that knowledge of 
their own cognitive style increased their awareness of 
the diversity of human beings. 

5. The majority of students demonstrated enthusiasm for 
the cognitive style mapping experience as indicated by 
their readiness to recommend the experience to other 
students. 

6. The impact of the mode of interpretation is evidenced 
primarily in the questions pertaining to the perceived 
validity of the cognitive style map. Individual Interpre- 
tation of a student's map by the instructor seemed to 
influence the perceived accuracy of the map and the 
extent to which students believed their cognitive style 
was understood by their instructor. 

Results of the student questionnaire imply that the stu- 
dents, on the whole, did find the cognitive style map 
experience to be positive. However, the reason for the 
positive attitude cannot be easily isolated and identified. 



Conclusions Based on Impact Research 

The following conclusions are based on the results^of edu- 
cational efforts in the six implementation settings and the 
results of evaluation activities across settings. 

1. Little or no relationship was found between the 
measurt: of style used in this project and educational 
outcomes. (See the humanities and educational psy- 
chology settings.) 

2. When the match between student style and mode of 
instruction or teacher style was used to predict course 
outcomes, prediction was found to be Inaccurate. (See 
science, hum?.nlties, and education* I psychology.) 

3. The large amount of wlthln-group variance In style mea- 
sures relative to between-group variance made the reli- 
able differentiation of group on the basis of s^tyle diffl- 

. cult. (See physical education and graduate education.) 

4. Student reactions to the cognitive style mapping proce- 
dures ranged from undecided to positive. Students 
reported that these procedures had little real impact or 
value to them but suggested that cognitive style should 
be considered by other teachers. 

5. Participating teachers enthusiastically supported the 
concept of cognitive style mapping. 

These results must be carefully interpreted In light of the 
discussion of the validity of the measures at the beginning 
of the chapter, p. 19. 
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CHAPTER 5 



SUMMARY AND RECOMMENDATIONS 



The two-year project was an attempt to implement and 
evaluate a set of procedures designed Jo aid educators in 
individualizing instruction at the postsecondary level. The 
evaluation focused specifically on procedures developed 
by Dr. Joseph E. Hill of Oakland Community College in 
Michigan for measuring and mapping each student's edu- 
cational cognitive style and using the resulting maps to 
individualize educational programs to accommodate 
students' styles. 



The specific project objectives were: 

1. to devise, develop, field test, and refine procedures for 
the measurement of the various dimensions of Hill's 
model of educational cognitive style; 

2. to train faculty and staff ih (5i)stsecondary educational 
settings to understand the conceptual frarriework of 
educational cognitive style; 

3. to assist these trained facuity members in developing 
and carrying out plans for implementing cognitive style 
mapping procedures in making educational decisions in 
their Individual settings; and ' 

4. to plan and carry out systematic and objective evalua- 
tions of the effect of the'cognitive style mapping proce- 
dures and data on educational outcomes in each imple- 

--mentation setting. 

During year one of the project, the groundwork was laid 
for the Implementation and evaluation by developing the 
measures of style, traini'ng faculty, developing specific Im- 
plementation plans, and developing evaluation plans. Dur- 
ing year two, the implementation plans were put into 
action, and the evaluation data were gathered. Although 
there were only six implementation and evaluation set- 
tings In two Michigan Institutions, the project results will 
provide direction to future educational cognitive style 
researchers. Consequently, It can be concluded, as sum- 
marised below, that ihe project achieved Its objectives. 



Training 

. Training objectives established at the outset of the training 
phase of the project called for participating staff at MCCC 
and. MSU to acquire sperlflc knowledge and skills that 
wojjid allow them to implement cognitive style maps 
appropriately In their own educational environments. A 



variety of training procedures were used over a period of 
six months; seven faculty members achieved sufficient pro- 
ficiency In the mapping of knowledge and skills. Multifac- 
eted evaluations of the cognitive and affective outcomes of 
training suggested that this phase of the project was car- 
ried out very effectively. 

Developing Measures of Style 

Objectives were also estabfished at the outset of the pro- 
ject for the selection, field testing, and evaluation of pro- 
cedures for measuring 32 dimensions of educational cog- 
nitive style. Participating cognitive style experts used avail- 
able ACT measurement instruments and adapted OCC 
instruments to assemble a battery of cognitive style mea- 
sures. These experts also established the face and content 
validity of the measures and the dimensions of style. The 
battery was pilot tested during year one. Excessive admin- 
istration time during the pilot testing resulted iri revisions 
that shortened the Instruments for use during the year two 
Implementations. . ^ 

Technical analysis of the data resulting from the second 
administration suggested that the revisions yielded greater 
efficiency. The analysis also suggested that the various 
measures of style dimensions were sufficiently reliable. 
However, the validity of the rneasures as indicators of the 
various style dimensions cd.uld not be demonstrated 
empirically. Intercorrelatlons between independent mea- 
sures of the same style dimensions using the project bat- 
tery and the most curient OCC cognitive style battery 
yielded chance correlations throughout, suggesting .that 
corresponding measures were not tapping the same 
learner characteristics. 

In the research on educational cogniti\re style completed 
to date, little or no data have been presented to demon- 
strate the psychometric adequacy of the measures 
employed. In those instances where validity is addressed, it 
is nearly always content or face validity based on expert 
judgment. Future research and development efforts focus- 
irig on educational cognitive style should give serious 
attention to the development or adaptation of measures 
that are demonstrated to be validiand reliable using all 
relevant scientific and psychometric standards as criteria. 
This work must be completed before implementation and 
evaluation of the impact of style can be generalized across 
settings or measures. 
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Assessing Impact 

The final major objective of the project was to conduct a 
thorough and systematic evaluation of the impact of edu- 
cational cognitive style on educational outcomes. This 
evaluation was conducted through the implementation of 
cognitive style mapping procedure? in a variety of post- 
secondary educational settings. Participating educators 
planned for and implemented the experimental proce- 
dures in their regular classes. In addition, they planned for 
and supervised the, collection of evaluation data in those 
classes. As a result, some useful information on the rela- 
tionship between cognitive style mapping and a variety of 
educational outcomes was generated. 

Summary of Results 

Seven implementation studies were planned and six were 
carried out in two postsecondary settings: Macomb Coun- 
ty . Community College and Michigan State University. 
These addressed several important issues pertaining to the 
impact of using cognitive style mapping results in praaical 
educational settings. Results from all of the sites that 
carried out their research plans are summarized below. 

Foirr implementation studies were carried out at MCCC. In 
a science class, retention rate ar d final grades were 
enhanced by the individualized prescriptive treatment 
with or without cognitive style mapping. The true impact of 
cognitive style information is not clear due to several con- 
founding factors in the design and its execution. In a 
humanities class, a series of stepwise regression proce- 
dures using student cognitive style data and match scores 
to predict final exam scores (using four probable modes of - 
understanding — lecture, group discussion, media, and 
overall course) showed little relationship between these 
cognitive style variables and course outcomes. Special 
needs students who participated in the fall 1976 orienta- 
tion program (experimental, cognitive style) tended to 
complete more course hours than did the previous year's 
orientation group. However, a lower grade point average 
also resulted for the group that had its maps interpreted, 
and jew students showed hoped-for growrth in the basic 
.skills elements of the map. Attempts to generate consis- 
tent collective maps across a variety of methods failed in 
the physical education site. The large amount of within- 
group variance relative to between-group variance was 
cited as the principal explanation for this outcome. 

Three implementations were planned at MSU and two 
were carried out. Participants at the Counseling Center 
.were unable to implement their research plans, educa- 
tional psychology classes were the context for ar investi- 
gation of the relationship between student and teacher 
match scores on academic and attitudinal outcomes. Little 
relationship was found. In the graduate education curric- 
ulum class, students were sorted into two instructional 
groups to match their cognitive styles. Partly because of the 
large amount of within-group variance on the key map ele- 



ments used in group identification, it was found that the 
groups did not differ reliably on key map elements. 

dverall, the six studies did •.ot establish the existence of 
significant relationships between the use of cognitive style 
measures and data on educational outcomes. These pro- 
ject results were supplemented with firsthand reports of 
participating teachers and students; teachers were inter- 
viewed after implementation and students were adminis- 
tered an attitude survey.. Both groups had generally posi- 
tive attitudes about the experience. 

Rewiew of LimUations of the Research 

Because of the nature of the evaluation contexts, some im- 
plementation problems occurred at nearly every site. 
These problems sometimes impacted the internal and 
external validity of the results. "/ 

In the science implementation, the instructor may have 
biased the control treatment by empirically (subjectively) 
mapping students. For some control group students, then, 
the prescriptions were based on empirically mapped cog- 
nitive styles rather than randomly assigned. Further, those 
students who received prescriptions based on their cogni- 
tive styles were permitted to self-select any other materials 
they wished. Finally, the results are further confounded 
because students were given information about the 
research intent and expectations. 

The ,students in the humanities class were subjected to 
nearly two weeks of testing and interpretation of test 
results. Although" the instructor feels that more efficient 
instruction was possible because of the test results, many of 
the students expressed concern over the loss of class time 
to testing. 

Students in the special needs program were not required 
to take the cognitive style test a second time in Decerr.ber. 
Although special arrangements were made to encourage 
student participation, less than one-third were retested. 
The characteristics of the volunteer sample are unknown, 
and thn generalizabilil/ of the results is definitely limited 
by the small retest sample size. 

Originally, the physical education implementation was to 
continue into a second term. Jhe plan was to select poten- 
tial unsuccessful students, give half of them prescriptive 
instruction, then compare the performance of successful 
and unsuccesful students. However, this plan was^not fol- 
lowed through, because the instructor accepted an admin- 
istrative position in the college. 

The educational psychology implementation proceeded as 
planned. It appears that the data resulting from this study 
were relatively free of confounding factors. 

The graduate education curriculum implementation also 
proceeded as scheduled. However, the small sample size in 
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this setting and the Igck of control data impacted the 
research design and the strength of the conclusions. 



revealing the impact of methodological problems, it also 
highlights the true value of the project. 



The lirfiitations of the implementation at the MSU Coun- 
seling Center were the most serious of all. The directors of 
the Counseling Center who developed the implementa- 
tion plans were unable to obtain the necessary coopera- 
tion rrom the counselors at the center to carry out the 
study. 

Finally, an additional factor necessitates careful interpreta- 
tion of the impaa research results: the validity concerns 
identified in the previous chapter. If the instruments used 
in the study are not valid measures of the learner variables 
they are said to measure, then use of the map data could 
well result in erroneous decisions. 

Collectively, these problems have the effect of reducing 
the generalizability of the findings and the breadth of the 
conclusions that can be drawn. However, they do not 
entirely negate the value of the research. Although they 
make it difficult to study cause and effect links between 
cfognitive style mapping and educational outcomes, they 
do represent acceptable analyses of the relationship 
between cognitive mapping and educational outcome. 
This is an important distinction because, in addition to 



Recommendations for Future Research 

The five studies conducted during this project do not pro- 
vide a basis for judging the extent to which educational 
cognitive style mapping can impact the outcomes of post- 
secondary educational experience. To date there has been 
little hard data to document that students with different 
styles learn better when provided with different instruc- 
tional treatments. This project did not shed a great deal of 
additional light on this matter. Untjl such a causal link is 
established there is little reason to believe that the learn- 
ing characteristics represented in the cognitive style map 
are any more appropriate or useful than the variables 
included in any other profile of student aptitudes, inter- 
ests, and attitudes. 

Establishing such links will require, as a first step, measures 
which , reliably and validly measure cognitive style attri- 
butes. To that end, it is recommended that substantive 
effort and resources be devoted to the development of 
technically sound instruments for assessing cognitive style 
elements. 
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APPENDIX 

EVALUATION ADVISORY PANEL REPORTS 



Year One Report 

This is the first report to be filed in writing by the Advisory 
Panel for the Cognitive Styles Project. The panel members, 
whose names appear below, have made two site visits to 
ACT headquarters in Iowa City: one in the fall of the year 
and one in the spring. The members have been supplied 
with the proposal as funded, a supplementary document 
regarding evaluation of the proposal, a copy of the renewal 
proposal, and publications from OCC related to cognitive 
styles. During the visits, the panel has had an opportunity 
to hear reports from Dr. Joseph , Hill and Ms.^ Linda 
Henderson, vyho had the major responsibility for carrying 
<^»ut the activities described In the proposal. Reports have 
also been received from staff members assigned to the pro- 
posal by ACT; an additional report was received from Pro- 
fessor Glen Lahti, Department of Humanities, Macomb 
County Community College. 

The format of the panel members' consultancy has been to 
receive from the project participants written and verbal 
reports of plans and progress made thus far. The panel 
members have also reviewed the test materials developed 
by ACT staff members, but It Is important to emphasize 
there have been no direct site visits ic the colleges where 
the program is being carried out. 

An additional resource for the panel's deliberations has 
been the participation of Dr. William h. Taylor, Dean of 
Students at Polk Community College, where the Cognitive 
Styles Program has, been actively utilized for nearly four 
years. Dr. Taylor has the most long-standing acquaintance 
with the content of the project, and the other members of 
the panel depend on him for background comment. None 
of the remaining panel members can claim intimate 
acquaintance with the literature or projects which have 
grown out of Or. Hill's work. ' 

It is the^hope and Intention of the panelists that this report 
will be found constructive in its comments and encourag- 
ing to the participants and to the Fund. The panel agrees 
that there is ample reason to hope that the cognitive styles 
approach represents an Improvement in concept which 
may lead to possibilities of implementation of instruc- 
tional strategies which heretofore have not followed from., 
other similar kinds of testing efforts. The panel also 
understands that the Fund is devoted to development and 
implementation supports, rather than the support of theo- 
retical research. Within these constraints, we hope to offer 



suggestions which will prove benelrcial to all concerned 
with the project. \ , 

Formative Evaluation 

Dr. Hill has suggested that evaluation of the extent to 
which the project is achieving the goals it set for itself in 
the first year be viewed as formative, by which he means 
devoted to an assessment of whether or not the proposed 
actions are, in fact, being undertaken. Following comple- 
tion of these actions, the assessment of the project out- 
comes will constitute a final evaluation which must take 
Into account the project as finally conducted. The panel 
accepts this distinction and wishes to offer the following 
formative comments. 

A. The project plan calls for the selection of participant 
teachers who will learn the cognitive styles system and 
the arts of cognitive mapping. They will then modify 

_ ; their instructional plans to accommodate student styles 
Identified by the Information so gained and carry out 
their teaching plans so that assessment of student gaJns 
can be made. The original intention was that the com- 
pletion of the teaching plan be achieved by.thebegiii- 
^ ning of the summer term. However, the decision was 
made to rely on teacher volunteers rSther than persons 
paid a small stipend to take part. In addition, it was dis- 
covered that there was an opportunity for participation 
by members of the School of Education at Michigan 
State University. These events have led to a slowing of 
completion of the schedule as planned. On the other 
hand, the addition of Michigan State Universit}/ may 
provide a unique and benefici^al data source for tlie 
evaluation work. Teacher training has begun, and the 
paiticipants are currently involved in the creation of 
their implementation plans. 

It is clear to the panelists that it will be important for the 
Project Director to state the criteria for accepting or, if 
necessary, rejecting these plans as submitted. We sug- 
gest that it might be wise to evaluate the plans accord- 
ing to criteria identified by those who have a sound 
sense of the cognitive styles approach. It might be pos- 
sible to grade or rate each teacher's plan so that. In the 
event some are quite superior to others, subsequent 
analysis can be performed with the estimate squarely in 
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mind. It is also important that whatever criteria are used 
to assign such ranks or-rgrades be objectively stated so 
that they, too, can be subsequently reviewed during the 
summative stage. 

A second issue we wish to emphasize is the necessity to 
urge the participating teacher? to state as clearly as pos- 
sible which aspects of student'performance within their 
courses they hope to see improved or strengthened by 
their teaching plan. It may be wise to urge upon them a 
minimum number of within-course exarninations, 
paperS;, and other assessments — e.g., not fewer than 
four separate measures — so that adequate comparisons 
across courses may be made. 

A third recommendation is that occasional course visi- 
tation be made in an effort to provide independent 
assessment of the recognizable degree to which the im- 
plementation plan of each teacher is, in fact, being met. 
This might be best accomplished by a modified critical 
incident technique whereby the teacher is urged to 
invite an observer to come and see a course session 
which the teacher feels is an especially good example of 
the type of instructional effort being made. 

B. The instrument development schedule established for 
ACT is clearly being met. The materials are now in hand, 
ready for use as scheduled. The preliminary statistical 
analyses of these new instruments — dealing in particu- 
lar with reliability coeifficients — will benefit from con- 
tinued refinement with special attention given to gen- 
erating reliabilities for the item cutoff strategies being 
adopted for use in the computer scoring procedures. 
This second level of reliability assessment should prove 
valuable when the time comes to review those items 
and batteries which may prove to have least predictive 
value. Otherwise, it is the panel's judgment that the 
instrument development schedule is being met accord- 
ing to plan. 

C. In order to use the instrument, participating teachers 
must be trained in the art of cognitive mapping, ''^m:: 
panel feels it important that records be kept of the y^'- 

, formance evaluation made of the degree to which "jch 
teacher displays an acquaintanceship with the s'. stem 
and an ability to understand such mapping. In particu- 
lar, we feel it important to elicit from the parti .,p;.(ing 
teachers their personal statement of how the r jrmative 
mapping made of their class group has alter .d or pro- 
vided the base for modifications that they :t Ae in their 
teaching plarh. We are suggesting here /,hat a*" the 
teachers proceed through^ the teaching ' -rm, they be 
encouraged to keep a journal or diary of hovV they are 
using their knowledge of the cognitive style scores. 

Summary 

The general assessment that the panel wishes to offer of the 
progress toward first year objectives is that, although the 



timing has necessarily lagged because o^ /^'aHf;es made in 
the plan so as to take advantage of new KKrponur\\ue.s, the 
objectives are achievable. However, c /j :«feguard against 
having to proceed to implementati^ 'n before all of (he 
training time thought necessary ha? . ,cen spent, we urge 
adoption of these additional con» y.ous evaii-^ition pro- 
cedures so that subsequent vari^r :.*! in perfor.nance may 
turn out to*be predictable fron^ ^ese new assessments of 
achievement in the training p^ / e. We find, too, that the 
procedures established in the .'-.rJt proposal are being hon- 
ored by all parties, and that t e capacity and willingness to 
provide improvements in t' le current evaluation plans are 
very much in evidence. chief deficiency that we sense 
to date relates to the cor /pletion of the summative assess- 
ment design prior to ihe seconci'year implementation 
phase. It is the panel's ' j -lgment that at least the outlines of 
the design should be n place and agreed to by the partici- 
pants prior to the bpv^ir.ning of tho actual implementation 
phase. Under the p' r^erit schedule, there is a strong possi- 
bility that this will ^lO? be achieved, and we' urge that ACT 
staff make the p.nierement of this design a 'high priority 
effort. Overall, ivo fifid^ the project on time and on course 
with some ex» jling possibilities in prospect. 

Addendunr / 

We are veil aware that FIPSE does not support basic 
researC , This project focuses on the application of a sys- 
tem v'\ACh has been several years information; upon its 
com^-lnVion, we may have evidence that the system 
desf ves further development and dissemination. How- 
ever, we think it important that the furiders realize that in 
o ;-i-r for the system to achieve legitimacy in the eyes of 
r v/chologically trained persons, who will most certainly be 
^sked in time to pass judgments on further proposals for its 
implementation and' use, it will' be necessary provide 
potential users with a brief document, perhaps nd more 
than five pages, which summarizes the theoreiicai frame- 
work out of which the cognitive styles thinking h.-js come. 
This piece should also provide a significant bibliography 
chosen to provide the reader with an opportunity to 
explore the theses and publications which will provide a 
sense of the research ev^idence. At some point it will.be 
necessary to conduct anijlytic studies of the instrument so 
as to satisfy the normal and responsible qjestions which 
will be posed regarding the cognitive sty,les instrument and 
itf construct validity as seen in the context of other similar 
research. This is an effort which can be incorporated in 
part into the present project if other test data lYor,-:- the par- 
ticipating students can be made available to ACT. If there 
are difficulties securing such material, it wiJ'i simply mean a 
postponement of the time when such comparisons will \ 
have to be made. 

A second^kind of observation may also be made regarding 
the issue of systems evaluation. The project essentially 
entails the beginn.**"^" s^f what will eventually have to be an 
ambit. -cjus effort to evaluate ti";e us^. fulness of an entire sys- 
tem. The procedures being followed i.*^ the project are pro- 
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totyrorak. ai\i"r nwf b:* k/oked od ?.s preliminary e/plocy- 
lory (-:xp6rifMU'&*> i': 'iy«em b:ji}dfl;g. Thi5 projsc^ will shed 
con.si Jerab-c iit^h: on how the sysii*rTi c^Mtion m«ji:^^ pro- 
ceed. ?A {we e^aUi*J?ion of f he sv.U'em for its own saki'^ 
musl b^.^ turned -.^u*. Ihus. the.priCiientiUion o'l vhc cCtrii- 
tlve sUli^ initrumtriV}.. lhi» iralnirig of pr-rsons in Its use, ^he 
applic.' ^'iOfk ic\TOVv'^:*f;j*:e' )\*eimrased ^>y ,lhev;esv ba,ttery to a 
of5Ci'\ •! r.:v:ijexi,, arvii c^ie d''Sign of anpt 'priSve' assess- 
n.f-,>t \l«chfr.)ic^"Aos an? Vi*. r.^j.viee 'ivhicH yl^ld to direful ar.d 
<.y'•^l'/MT}i<ltK'.'i'J^'a^.^i\♦. fe'is ^^^'vnei-.^s is b-24n>^ p-if- 

viisljy ev..v,uaK*'d .n ihe pN.'.sofs* pioifr?':, t;ur, In Diroe, a rnii-:.ih 
more formal evaluaHldn prOji3cl of 'i''j<.h 3 s>ste'iT''f, iaf>pro2:':!\ 
will have to be carried out. 

This brings us to our final observation. We are impressed 
with the magnitude of difficulty the project members face 
in achieving the objectives they have set for themselves. 
The two-year effort for which funding is presently in place 
will, in our judgment, f«quire repetition before suffic'snt 
experience is gained to provide relatively clear ^nd 
unequivocal statements of the values which can be-^'eal- 
ized. We thi.ik it important to emphasize the-open-ended 
character of the current projeci and the extent to which 
this project is part of a continuing effort to determine the 
usefulness of the cognitive styles approach. It is for this rea- 
fdn that we wish to reemphasize the need for ACT staff to 
capture unobtrusively as much supplementary informa- 
tion as possible about e"^ch arxJ every phase of the project 
as it progresses. This type 01' informaiion, examples of 
which are given above, can then provide in ihe summative 
evaluation stage fireit estimates of the effectiveness of vari- 
ous elements in The system which, strictly speaking, are not 
the focus and object of itudy. 

We hope these suggestions and observations prove useful 
to members of the projevCt and the Fund for the Improve- 
ment of Postsecondary Education. 



End of Project Report 

Implicit in the Fl'PSE Project on f ducational Cognitive Style 
was a "field tebl" of the Hill model at Oak/ir7nd Community 
College which vt'ould embrace the r^effr^^^mcnt of mea- 
surement instruments, the training of proresslcnal staff in 
educational cognitive style .mapping, dr,<\ the develop- 
ment and' implemeniation of projects ir. ^(Sr^ous settings at 
Michigan State Univev'iity and at MacoiT>b County Com- 
munity College. 

. Project Design Requirements 

The requirements of the design used in the educational 
cognitive style project can be viewed from a systematic per- 
spective. Essentially, the project consisted o^ 1) construc- 
tion of assessment devices; 2) training in profile interpre- 



ttv\ot\, 3f pedagogical applicatioiiS: and 4) summative eval- 
uation of the impiia of the appiicalkn^ on teacher atti- 
tudes and on siudcfi' attitudes and performarvre. These 
^.omp/^nents untohi in /a time sequence, which is Itself 
•Traj k"d off by deadlines and standards of competency. An 
ade».|U.?te tes: oi the ba«-ic effectiveness of the cognitive 
style ii*r^?.jnT^nt rcxjuireii il'uit •each step in the system meet 
oppjopriat^ M'.jrdaiCU . In cases wht^re such standards are 
rot U e!r:7n;»Q-. tht^t provisUm be made rcr repeat- 
Ifi!? wtc prca'CSb ao*'! 'Ht) iv»,iniri",);il iUTidi^rds are achieved. 
Only M .< rr: i'hp^. :' :v1an^.^^^ds j.'^: rr^ei C;in v/l be sure that ihe 
irr^rv'i?rii';ofv p:-- pU<r nf ri .iCiualiy :.r.>rk:nf^ pLci?, ii v/^? vhr^vv 
The pr^jca vrarv fhls- (:o.r<.>.ictive, tli*?. :>uei\';i< '^^ ^nvi vvejfk* 
nesses of the effor* ot*=j »:bvlou^. 



Initial Phases of Recruitment and Selection of Teachers, 
Training of Teachers, and Pedagogical Design 

Teachers were recruited for the project by experts in the 
use of the cognitive style measures from Oakland Com- 
munity College and The American College Testing Pro- 
gram. The incentives for participation were modest, con- 
sisting of the necessary release time and small stipends for 
weekend involvement. Thus the primary incentive for par- 
ticipation was the teachers' interest in the subject itself and 
their desire to explore its possible usefulness. Most of the 
teachers recruited were apparently well suited to the pro- 
ject, though it does seem clear that a wider applicant pool 
with more powerful incentives would have produced a 
group of teachers more knowledgeable about the field and 
better able to participate in the project. 

Teacher training was carried out in two- to three-hour 
study sessions, with occasional opportunities to practice 
profile interpretation. Some participation was lost at this 
point; the experts selected the final seven participants by 
evaluating their ability to provide adequate interpretation 
of student profiles. Testimony of the participants, as well as 
the report of the project staff, indicates that the range' of 
performance vis-a-vis the, minimum standard was consid- 
erable. There is a seneral sense that, had time and dead- 
lines permitted, more effort could have been profitably 
devoted to this phase of the project. 

Civen the selection of the teachers and the conclusion that 
they had at least a minimum mastery of the Instrument, the 
next phase was the design of course applications of peda- 
gogical technique to matc^" the profiles of the students, 
and/or to carry out certain clearcut instructional modes 
with an eye to testing the effectiveness with which stu- 
dents with different profiles responded to therri. Experts 
reviewed these designs to check on their theoretical 
plausibility and suitability. Thi*^ was a fairly demanding 
phase of the program for the teachers, and the combina- 
tion of monetary and intrinsic incentives was u^ed. it is evi- 
dent that for many teachers this was the .nosl enjoyali^le 
portion of the project, and, once again, they would have 
liked more consultation and more time to gain confidence 
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that the pedagogical modes selected were well Hesigned. It 
is our impression that the justification of these designs was 
informaiiy carried out in conference between the teacher 
and an expe*^ , and not subject to any systematic review 
against some common set of standards. Ideally, in a care- 
>.;lly.-de5igned effort, this would be the moment when 
careful and intense review would take place, and those 
desigr» Dropos;ik found to be weak would be rc^turned for 
further 

With this phase of the projec^ concluded, it then remained 
io implement the instructional dv:::oria— )ncii:ding testing 
the stuncaiS'tir'id informing them, where called for, their 
profile findingf.. Tif.^f^ experts periodically monitored 
the implementation. Su»>set;iiently, teacher 3,nd studeiw 
estimates were gatbereri of uSe extent to which the 
insrruaional effort was mfluf^nced by the use of the 
cognitive style assessm int. 

Implerr.entations of this kind are always '•aniet^ ovi wiihir' 
the constraints defined by the larger system with'/r« whfch 
the experiment is taking place. This particular design did 
not call for any accommodation by the larger system; 
rather^ the instructional practice was wholly conventional 
from the perspective of the institutions. This means that no 
special types of instruction had to be attempted beyond 
those normally tolerated in the system, and no r.-ndical 
demands were placed on the system, it means, too, that the 
teachers and the students were opcfating within the usual 
and conventional expectations and incentives which moti- 
vate teacher and student outcomes, Th'*s is laudable 
because it minimizes the possible effects of "specialncss" 
that often produce their own outcomes. Monitoring of t.'ie 
implementation could only be occasional. Ordinarily, it 
would be important to have frequent and widespread 
observation of the ways in which the teachers attempted to 
implement their knowledge of the students' cognitive 
styles. 

Jht final stage of the design was the col ection, collation, 
analysis, and interpretation of the outcome measures 
selected to test the effects of the instruction. In this case, 
the measures as collected were primarily attitudlnal and 
introspective, with only a few objective performance mea- 
sures available. Obviously, a wide vanety of measures were 
possible. We might have chosen that particular teacher 
whose efforts seem to have set the highest standards of 
performance to the design and have treated that class by 
the case method: learn as much as poisibleabout It and do 
our best to infer what may have occurred there. Or, we 
might have used a multi-factorial design In which certain 
treatments were systematically varied across others so that 
factors having social importance—such as norm groups, 
subject matter, teaching method, and perhaps economic 
efficiencies — could be assessed as contributory to cogni- ' 
tive style effects. In tiiis project, neither the case method 
nor the multi-factorial design could be used. The seven 
classes for which data could be obtained may best be 
described as providing us with a mixed picture which shed 



EKLC 



some light on specific possibilities but which, when taken 
together, were not sufficiently systematic to provide a 
clearcut Interpretation. The evaluative assessments as col- 
lected are reasonably usable, and do provide a rather clear- 
cut interpretabic outcome. However, the causal analysis 
which vv-e might seek Is more difficult to complete sMce the 
project provides limited performance outcome data, and 
attitudlnal expressions are not supportive of the inference 
of cognitive style effects. ^ 



The ACT Measurement System and Us Analysis 

1. The ACT staff, in cooperation with Dr. Hill, built a mear 
;,Jrc.T»ent system that seemed to reflect the cognitive 
style con:»ructs previously embodied in the OCC Instru- 
ments. It wdb reported that Dr. Hill seemed satisfied tha? 
the resulting ,^CT system was a.": adequate, perhaps 
even improved, t/.Laiuremeni byMem. 

I U part of data collection in the various Implementa- 
fiO). .'{t^5? ACT gathered a variety of data btunng on the 
evaluaiivLTi af'The instrument. However, unforeseen and 
uncontrollable tvon^stn some sites forced the compro- 
mise of data collection pii^rj*. K?nce, a full evaluation of 
the ACT Instrument and its reia<i-:m to the OCC Instru- 
ment Is not yet In hand. 

3. Within the limits of the data collected, ACT has faith- 
fully endeavored to examine from several viewpoints 
the educational and psychometric qualities of the mea- 
surement system. The process Is one of detective work 
in a complex data set, rather than merely the applica- 
tion of routine psychometric and statistical methods. 
The ACT staff are to be commended for their thorough 
and thoughtful pursuit of the various empirical ques- 
tions that can be asked of the data. At^this writing, all 
relevant data analyses are not yet completed. Data are ' 
still coming in, arid further ideas on data analysis iire still 
emerging. 

4. With respect ro the evaluation of the ACT measure- 
ment system as an assessment of Hill's educational cog- 
nitive styles concept, one can apply six separate cri- 
teria': a) internal consistency rellabil^'ty of the measures; 
b) stability of scores over tfme; c) interrelationships (or ■ 
redundancy) among the different tlimensions presum- 
ably measured within or between Instruments; d) extent 
of correlation between like constructs based on differ- 
ent methods of measurement (e.g., between like 
constructs measured by the ACT and the OCC 
measures); e) predictive validity of style constructs in 
educational settings; and f) prescriptive or differential 
validity of style constructs In such settings, to demon- 
strate that the constructs are actually useful in prescrib- 
ing different instructional treatments that benefit indi- 
viduals, relative to, e.g., random assignment to 
treatments. 



60 



The complexity of the assessment procedure and con- 
cepts, however, makes each of these six criteria appli- 
cable at three different levels in the measurement sys- 
tem. At one level, one can ask about the adequacy of 
each of the Independent base measures in the system. 
At another level of abstraction, one can ask the same 
questions about ^ the map element scores derived 
through linkage rules from the base measures. This is 
complicated by the fact that some linkage rules are , 
complex. Beyond this, one can inquire about adequacy 
. and usefulness of the system at the level of the style pro- 
file descriptions and the educational prescriptions 
derived from these. 

We can now review each of the six criteria, keeping in 
mind the three-level complexity, to document ACT's 
•evaluation activities regarding the measurement sys- 
tem. We shall not try to describe in any detail the 
empirical rlesults; this is the province of ACT's further 
analyses and nnol report, yet to be drafted. 

a) ACT obtamed internal consistency estimates of reli- 
ability at the levels of individual base measures and 
some individual map elements. Most of these esti- 
mates show adequate reliability in this sense, though 
some scales show a level of reliability insufficient for 
Individual prescription. It should be noted that indi- 
vidual prescription typically requires a much higher 
level of score eccuracy than institutional or research 
uses of educa'ional-psychological measurement 

b) btab*::^V ^ver time \^ the more significant aspect of 
reliability or interest here because, for prescriptive 
purposes, style construct^ must be regarded as rela- 
tively enduring characteristics of individuals. The sys- 
tem t measures derived from previous ACT test 
research may be said to possess stability over time to 

. the extent that these measures were not significantly 
rhanged in translating them for use in the style mea- 
surement battery. Unfortunately, the project site that 
was expected to produce some stability data failed to 
run as anticipated, so data on stability of other base 
measures, map elernents, or profiles were not 
obtained.' Ten individuals who were tested twice in 
one project show some variation in profile overtime, 
but these individuals experienced instructional inter- 
ventions between testings. Thus, the question of 

, stability remains open, at least with respect to most 
• map elements and profile characteristics. 

c) ACT has correlated base measures and some map ^ 
elements with one anothier, within and between the 
AG\and OCC batteries. Partial results suggest sub- 
stantial overlap between some purportedly different 
dimensions, but it is not clear if this overlap is of a 
degree high enough to justify reducing or combin-, 
ing measures. ACT rightly considers such a step 
somewhat premature. 

d) One site provided data allowing cross-correlation of 
like constructs from ACT and OCC batteries. These 

' fail to support the claim that any pairs of measures 



from the two batteries actually do measure the same 
constructs. It is therefore doubtful that profile clus- 
terings produced independently by the two batter- 
ies would place individuals in the same categories, 
but these analyses are as yet incomplete. ACT still 
needs to complete various statistical checks on these 
issues. 

e) Several siics yielded predictive validity data on the 
ACT battery. Analyses of these data are incomplete,, 
but preliminary evidence suggests that educational 
outcomes are not substantially prediried by style 
constructs. Some relationships may l e promising, 
however, and are being pursued. 

f) Prescriptive (differential) validity data were not 
obtamed. One site altered the planned conduct of'its 
study. While this may have had other virtues, it com- 
promised the value of the data on this point. Another 
site yielded data that may provide some evidence of 

' differential-validity, ;»«^r.Hing further arv^lyses. 

7. Within che limitations of the data, then, ACT has 
attempted to answer questions relating to the aboye six 
criteria as applied to the different levels of assessment 
provided by the system of style constructs. The limita- 
tions on the analyses possible are a function of prob- 
lems typically faced in field implementation and evalu- 
ation projects. It is unfortunate that the resources 
needed to support a stronger, more comprehensive test 
of the measurement system and its associated style con- 
structs were not available. ACT has thought ahead in this 
connection and has plans for more systematic research 
on and development of this system. This is to be com- 
mended. What seems required now is a thorough exam- 
ination of the concept of the system as it might be im- 
plemented in an instructional situation where compre- 
hensive and controlled evEluation studies could be car- 
ried out. it is hoped that ACT will be able to pursue this 
line of work more intensively. 

This review of the strengths and weaknesses df^.the project 
needs to be understood as illustrative of the effects of seri- 
ous time. and money constraints. The project was ambi- 
tious, and the participants are to be commended for the 
time. Intelligence, and effort they devoted *o it. Hov^ever, 
the requirements of the project clearly were greater than 
could.be met under its supp^ort terms. It remains unfortu- 
nately tiueJhat we continue to believe that such educa- 
tional efforts are relatively inexpensive and unsophisti- 
cated in their demands. Actually, great patlenCe, care, and 
time. must be extended to implement and assess a pro- 
gram in education. As yet, it does not appear that this fact is 
sufficiently appreciated. 

' Respectfully submitted, 

Robert Birney, Hampshire College 
John E. Roueche, The University of Texas at Austin 
William F. Taylor, Polk Community College 
Richard Snow, Stanford University 



61 {)J 



